Apr 29 10:25:13 devstack cinder-volume[75116]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 10:25:13 devstack cinder-volume[75116]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 10:25:13 devstack cinder-volume[75116]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 10:25:14 devstack cinder-volume[75116]: INFO dbcounter [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Registered counter for database cinder Apr 29 10:25:14 devstack cinder-volume[75116]: DEBUG oslo_db.sqlalchemy.engines [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:25:14 devstack cinder-volume[75116]: DEBUG dbcounter [-] [75116] Writer thread running {{(pid=75116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 10:25:14 devstack cinder-volume[75116]: INFO cinder.rpc [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 10:25:14 devstack cinder-volume[75116]: INFO cinder.rpc [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 10:25:14 devstack cinder-volume[75116]: DEBUG oslo_db.sqlalchemy.engines [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:25:14 devstack cinder-volume[75116]: INFO cinder.volume.manager [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Determined volume DB was empty at startup. Apr 29 10:25:14 devstack cinder-volume[75116]: DEBUG cinder.volume.manager [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75116) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 10:25:14 devstack cinder-volume[75116]: INFO cinder.volume.manager [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 10:25:14 devstack cinder-volume[75116]: WARNING stevedore.named [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 10:25:14 devstack cinder-volume[75116]: WARNING castellan.key_manager [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 10:25:14 devstack cinder-volume[75116]: WARNING cinder.keymgr.conf_key_mgr [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG cinder.volume.drivers.lvm [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75116) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_concurrency.processutils [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] CMD "cinder-rtstool verify" returned: 0 in 0.404s {{(pid=75116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_db.sqlalchemy.engines [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:25:15 devstack cinder-volume[75116]: INFO cinder.rpc [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 10:25:15 devstack cinder-volume[75116]: INFO cinder.rpc [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 10:25:15 devstack cinder-volume[75116]: WARNING stevedore.named [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 10:25:15 devstack cinder-volume[75116]: WARNING castellan.key_manager [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 10:25:15 devstack cinder-volume[75116]: INFO cinder.volume.manager [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_db.sqlalchemy.engines [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:25:15 devstack cinder-volume[75116]: INFO oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Starting 1 workers Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Started child 75292 {{(pid=75116) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Full set of CONF: {{(pid=75116) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] ******************************************************************************** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Configuration options gathered from: {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] ================================================================================ {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] allow_availability_zone_fallback = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] allow_compression_on_image_upload = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] allowed_direct_url_schemes = [] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] api_rate_limit = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] auth_strategy = keystone {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] az_cache_duration = 3600 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_availability_zone = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75292]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_host = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_name = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_stats_polling_interval = 60 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backup_api_class = cinder.backup.api.API {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backup_name_template = backup-%s {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backup_use_same_host = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backup_use_temp_snapshot = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] chap_password = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] chap_username = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cinder_internal_tenant_project_id = af7ea8481a0f4f33a5a8c37ebe8b8517 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cinder_internal_tenant_user_id = 1d383f9621d94925ab8191c42265e525 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cloned_volume_same_az = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cluster = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] compression_format = gzip {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] compute_api_class = cinder.compute.nova.API {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] config_dir = [] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] config_source = [] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] control_exchange = openstack {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] debug = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] default_availability_zone = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] default_group_type = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] default_volume_type = lvmdriver-1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] disk_geometry = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] driver_client_cert = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] driver_client_cert_key = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] driver_data_namespace = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] driver_ssl_cert_path = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] driver_ssl_cert_verify = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] driver_use_ssl = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] enable_force_upload = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] enable_new_services = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] enable_unsupported_driver = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] enabled_backends = ['lvmdriver-1'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] enforce_multipath_for_image_xfer = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] filter_function = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance_api_insecure = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance_api_servers = ['http://192.168.122.34/image'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance_api_ssl_compression = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance_ca_certificates_file = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance_catalog_info = image:glance:publicURL {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance_certfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance_keyfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance_num_retries = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance_request_timeout = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] goodness_function = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] graceful_shutdown_timeout = 5 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] group_api_class = cinder.group.api.API {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] host = devstack {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] image_compress_on_upload = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] image_conversion_address_space_limit = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] image_conversion_cpu_limit = 60 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] image_conversion_disable = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] image_upload_use_cinder_backend = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] image_upload_use_internal_tenant = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] image_volume_cache_enabled = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] image_volume_cache_max_count = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] image_volume_cache_max_size_gb = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] init_host_max_objects_retrieval = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] instance_format = [instance: %(uuid)s] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] iscsi_target_flags = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] iscsi_write_cache = on {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] iser_helper = tgtadm {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] iser_ip_address = 192.168.122.34 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] iser_port = 3260 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] log_color = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] log_config_append = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] log_dir = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] log_file = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] log_options = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] log_rotate_interval = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] log_rotate_interval_type = days {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] log_rotation_type = none {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] max_age = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] max_logfile_count = 30 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] max_logfile_size_mb = 200 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] max_over_subscription_ratio = 20.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] message_reap_interval = 86400 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] message_ttl = 2592000 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] migration_create_volume_timeout_secs = 300 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] monkey_patch = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] monkey_patch_modules = [] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] my_ip = 192.168.122.34 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] no_snapshot_gb_quota = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] num_iser_scan_tries = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] num_shell_tries = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] num_volume_device_scan_tries = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] nvmeof_conn_info_version = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] nvmet_ns_id = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] nvmet_port_id = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] osapi_max_limit = 1000 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] osapi_volume_ext_list = [] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] osapi_volume_listen = 0.0.0.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] osapi_volume_listen_port = 8776 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] osapi_volume_use_ssl = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] osapi_volume_workers = 2 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75292]: INFO cinder.volume.manager [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] per_volume_size_limit = -1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] periodic_fuzzy_delay = 60 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] periodic_interval = 60 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] project_id_regex = [0-9a-f\-]+ {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] public_endpoint = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] publish_errors = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] quota_backup_gigabytes = 1000 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] quota_backups = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] quota_gigabytes = 1000 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] quota_groups = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] quota_snapshots = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] quota_volumes = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] rate_limit_burst = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] rate_limit_except_level = CRITICAL {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] rate_limit_interval = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] reinit_driver_count = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] replication_device = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] report_discard_supported = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] report_interval = 120 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] reservation_clean_interval = 86400 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] reservation_expire = 86400 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] reserved_image_namespaces = [] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] reserved_percentage = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] rpc_response_timeout = 120 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] run_external_periodic_tasks = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] scst_target_driver = iscsi {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] scst_target_iqn_name = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_down_time = 720 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] shell_completion = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] snapshot_name_template = snapshot-%s {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] snapshot_same_host = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] split_loggers = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] state_path = /opt/stack/data/cinder {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] storage_availability_zone = nova {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] storage_protocol = iSCSI {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] syslog_log_facility = LOG_USER {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] target_helper = lioadm {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] target_ip_address = 192.168.122.34 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] target_port = 3260 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] target_protocol = iscsi {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] target_secondary_ip_addresses = [] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] trace_flags = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] transfer_api_class = cinder.transfer.api.API {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] transport_url = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] until_refresh = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] use_chap_auth = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] use_default_quota_class = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] use_journal = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] use_json = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] use_multipath_for_image_xfer = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] use_stderr = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] use_syslog = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] verify_glance_signatures = enabled {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_api_class = cinder.volume.api.API {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_backend_name = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_clear = zero {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_clear_ionice = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_clear_size = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_copy_bps_limit = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_dd_blocksize = 1M {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_name_template = volume-%s {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_service_inithost_offload = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volume_usage_audit_period = month {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] zoning_mode = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_concurrency.disable_process_locking = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.admin_password = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.admin_token = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.admin_user = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.auth_admin_prefix = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.auth_port = 35357 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.auth_protocol = https {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.auth_section = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.auth_type = password {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.auth_uri = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.auth_version = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.cache = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.certfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.identity_uri = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.include_service_catalog = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.insecure = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.interface = public {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.keyfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_password = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcache_username = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.region_name = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.service_token_roles_required = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.service_type = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.backend = dogpile.cache.null {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.backend_argument = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.backend_expiration_time = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.config_prefix = cache.oslo {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.debug_cache_backend = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.enable_retry_client = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.enable_socket_keepalive = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.enabled = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.enforce_fips_mode = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.expiration_time = 600 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.hashclient_retry_attempts = 2 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.memcache_dead_retry = 300 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.memcache_pool_maxsize = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.memcache_sasl_enabled = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.password = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.proxies = [] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.redis_db = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.redis_server = localhost:6379 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.retry_attempts = 2 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.retry_delay = 0.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.socket_keepalive_count = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.socket_keepalive_idle = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.socket_keepalive_interval = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.socket_timeout = 1.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.tls_allowed_ciphers = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.tls_cafile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.tls_certfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.tls_enabled = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.tls_keyfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cache.username = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] coordination.backend_url = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.asyncio_connection = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.asyncio_slave_connection = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.backend = sqlalchemy {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.connection = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.connection_debug = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.connection_parameters = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.connection_recycle_time = 3600 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.connection_trace = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.db_inc_retry_interval = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.db_max_retries = 20 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.db_max_retry_interval = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.db_retry_interval = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.max_overflow = 50 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.max_pool_size = 5 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.max_retries = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.mysql_wsrep_sync_wait = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.pool_timeout = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.retry_interval = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.slave_connection = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.sqlite_synchronous = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.synchronous_reader = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] database.use_db_reconnect = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.connection_string = messaging:// {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.enabled = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.es_doc_type = notification {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.es_scroll_size = 10000 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.es_scroll_time = 2m {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.filter_error_trace = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.hmac_keys = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.sentinel_service_name = mymaster {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.socket_timeout = 0.1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.trace_requests = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler.trace_sqlalchemy = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler_jaeger.process_tags = {} {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler_jaeger.service_name_prefix = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] profiler_otlp.service_name_prefix = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.enforce_new_defaults = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: WARNING oslo_config.cfg [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 10:25:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.enforce_scope = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.policy_default_rule = default {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.policy_file = policy.yaml {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_policy.remote_timeout = 60.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] privsep_osbrick.group = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] privsep_osbrick.helper_command = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] privsep_osbrick.user = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cinder_sys_admin.group = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cinder_sys_admin.helper_command = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] cinder_sys_admin.user = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_user.auth_section = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_user.auth_type = password {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_user.cafile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_user.certfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_user.collect_timing = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_user.insecure = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_user.keyfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_user.send_service_user_token = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_user.split_loggers = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] service_user.timeout = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance.auth_section = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance.auth_type = password {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance.certfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance.collect_timing = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance.insecure = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance.keyfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance.region_name = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance.split_loggers = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] glance.timeout = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.backend_availability_zone = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.chap_password = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.chap_username = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.disk_geometry = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.driver_client_cert = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.driver_client_cert_key = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.driver_data_namespace = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.driver_use_ssl = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.extra_capabilities = {} {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.filter_function = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.goodness_function = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.iscsi_target_flags = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.iscsi_write_cache = on {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.iser_helper = tgtadm {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.iser_port = 3260 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.lvm_mirrors = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.lvm_share_target = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.lvm_type = auto {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.num_shell_tries = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.replication_device = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.report_discard_supported = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.reserved_percentage = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.target_helper = tgtadm {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.target_port = 3260 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.target_protocol = iscsi {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.trace_flags = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.unique_fqdn_network = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.use_chap_auth = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.volume_backend_name = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.volume_clear = zero {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.volume_clear_ionice = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.volume_clear_size = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack sudo[75296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.volume_group = cinder-volumes {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_reports.file_event_handler = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_reports.log_dir = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack sudo[75296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.backend_host = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.chap_password = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.chap_username = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.chiscsi_conf = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.disk_geometry = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.driver_client_cert = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.driver_use_ssl = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.extra_capabilities = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.filter_function = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.goodness_function = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.iser_helper = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.iser_ip_address = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.iser_port = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.lvm_conf_file = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.lvm_mirrors = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.lvm_share_target = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.lvm_type = auto {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.num_shell_tries = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.nvmet_port_id = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.replication_device = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.report_discard_supported = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.reserved_percentage = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.scst_target_driver = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.storage_protocol = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.target_helper = lioadm {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.target_ip_address = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.target_port = 3260 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.target_protocol = iscsi {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.trace_flags = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.use_chap_auth = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.volume_clear = zero {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.volume_clear_size = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] lvmdriver-1.volumes_dir = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.ssl = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.ssl_version = {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_notifications.driver = [] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_notifications.retry = -1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] key_manager.fixed_key = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.barbican_api_version = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.barbican_endpoint = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.barbican_endpoint_type = public {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.barbican_region_name = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.cafile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.certfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.collect_timing = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.insecure = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.keyfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.number_of_retries = 60 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.retry_delay = 1 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.send_service_user_token = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.split_loggers = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.timeout = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.verify_ssl = True {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican.verify_ssl_path = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican_service_user.auth_section = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican_service_user.auth_type = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican_service_user.cafile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican_service_user.certfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican_service_user.collect_timing = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican_service_user.insecure = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican_service_user.keyfile = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican_service_user.split_loggers = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] barbican_service_user.timeout = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.approle_role_id = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.approle_secret_id = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.kv_mountpoint = secret {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.kv_path = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.kv_version = 2 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.namespace = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.root_token_id = **** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.ssl_ca_crt_file = None {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.timeout = 60.0 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.use_ssl = False {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:25:15 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] ******************************************************************************** {{(pid=75116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 10:25:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.832s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:16 devstack sudo[75296]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:16 devstack sudo[75372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:25:16 devstack sudo[75372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:17 devstack sudo[75372]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.703s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:25:17 devstack cinder-volume[75292]: INFO cinder.brick.local_dev.lvm [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 10:25:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:17 devstack sudo[75608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 10:25:17 devstack sudo[75608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:17 devstack sudo[75608]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:17 devstack cinder-volume[75292]: DEBUG cinder.brick.local_dev.lvm [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75292) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 10:25:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:17 devstack sudo[75787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:25:17 devstack sudo[75787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:19 devstack sudo[75787]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:19 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.396s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:19 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:19 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:19 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:19 devstack sudo[76036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:25:19 devstack sudo[76036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:20 devstack sudo[76036]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:20 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.702s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:20 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:20 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:20 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:20 devstack sudo[76069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 10:25:20 devstack sudo[76069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:20 devstack sudo[76069]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:20 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.656s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:20 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:20 devstack sudo[76079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 10:25:20 devstack sudo[76079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:21 devstack sudo[76079]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:21 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:21 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:21 devstack sudo[76083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 10:25:21 devstack sudo[76083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:21 devstack sudo[76083]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:21 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:21 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:21 devstack sudo[76087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:25:21 devstack sudo[76087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:22 devstack sudo[76087]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:22 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:22 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:22 devstack sudo[76091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:25:22 devstack sudo[76091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:23 devstack sudo[76091]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:23 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:23 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:23 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:23 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:23 devstack sudo[76096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:25:23 devstack sudo[76096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:24 devstack sudo[76096]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:24 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.797s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:24 devstack cinder-volume[75292]: INFO cinder.volume.drivers.lvm [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 10:25:24 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:24 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:24 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:24 devstack sudo[76104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:25:24 devstack sudo[76104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:24 devstack sudo[76104]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:24 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.830s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:24 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 10:25:24 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:24 devstack sudo[76214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 10:25:25 devstack sudo[76214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:25 devstack cinder-volume[75116]: DEBUG dbcounter [-] [75116] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:25:25 devstack sudo[76214]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:25 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.731s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:25 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:25 devstack sudo[76228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:25:25 devstack sudo[76228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:26 devstack sudo[76228]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:26 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:26 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:26 devstack sudo[76369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:25:26 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:26 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:26 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:26 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:26 devstack sudo[76375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:25:26 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:27 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:27 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:27 devstack cinder-volume[75292]: INFO cinder.volume.driver [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Driver hasn't implemented _init_vendor_properties() Apr 29 10:25:27 devstack cinder-volume[75292]: DEBUG cinder.volume.driver [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75292) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 10:25:27 devstack cinder-volume[75292]: DEBUG oslo_db.sqlalchemy.engines [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:25:27 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writer thread running {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 10:25:27 devstack cinder-volume[75292]: DEBUG cinder.db.sqlalchemy.api [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Building query based on filter {{(pid=75292) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 10:25:27 devstack cinder-volume[75292]: DEBUG cinder.image.image_utils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75292) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 10:25:27 devstack cinder-volume[75292]: INFO cinder.keymgr.migration [None req-f4ff5ce8-be15-4613-b8b1-8661ce32856b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 10:25:27 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 10:25:27 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:27 devstack sudo[76379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 10:25:27 devstack sudo[76379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:28 devstack sudo[76379]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:28 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:28 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:28 devstack sudo[76382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:25:28 devstack sudo[76382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:28 devstack sudo[76382]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:28 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:28 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:28 devstack sudo[76385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:25:28 devstack sudo[76385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:29 devstack sudo[76385]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:29 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:29 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:29 devstack sudo[76389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:25:29 devstack sudo[76389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:30 devstack sudo[76389]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:30 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:30 devstack cinder-volume[75292]: DEBUG cinder.manager [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Notifying Schedulers of capabilities ... {{(pid=75292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:25:30 devstack cinder-volume[75292]: INFO cinder.volume.manager [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Driver initialization completed successfully. Apr 29 10:25:30 devstack cinder-volume[75292]: INFO cinder.manager [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Initiating service 2 cleanup Apr 29 10:25:30 devstack cinder-volume[75292]: INFO cinder.manager [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Service 2 cleanup completed. Apr 29 10:25:30 devstack cinder-volume[75292]: DEBUG cinder.service [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Creating RPC server for service cinder-volume {{(pid=75292) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 10:25:30 devstack cinder-volume[75292]: DEBUG cinder.service [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75292) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 10:25:30 devstack cinder-volume[75292]: INFO cinder.volume.manager [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 10:25:30 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 10:25:30 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:30 devstack sudo[76396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 10:25:30 devstack sudo[76396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:30 devstack sudo[76396]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:30 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:30 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:30 devstack sudo[76400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:25:30 devstack sudo[76400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:31 devstack sudo[76400]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:31 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:31 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:31 devstack sudo[76403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:25:31 devstack sudo[76403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:32 devstack sudo[76403]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:32 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.597s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:32 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:25:32 devstack sudo[76429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:25:32 devstack sudo[76429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:25:32 devstack sudo[76429]: pam_unix(sudo:session): session closed for user root Apr 29 10:25:32 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:25:32 devstack cinder-volume[75292]: INFO cinder.volume.manager [None req-e2c97e90-2a21-4988-8baa-c06c0d05038f None None] Driver post RPC initialization completed successfully. Apr 29 10:25:42 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writing DB stats cinder:SELECT=2 {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:25:42 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:26:14 devstack cinder-volume[75292]: DEBUG oslo_service.periodic_task [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:26:14 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 10:26:14 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:26:14 devstack sudo[78030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 10:26:14 devstack sudo[78030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:26:15 devstack sudo[78030]: pam_unix(sudo:session): session closed for user root Apr 29 10:26:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:26:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:26:15 devstack sudo[78034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:26:15 devstack sudo[78034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:26:15 devstack sudo[78034]: pam_unix(sudo:session): session closed for user root Apr 29 10:26:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:26:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:26:16 devstack sudo[78037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:26:16 devstack sudo[78037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:26:16 devstack sudo[78037]: pam_unix(sudo:session): session closed for user root Apr 29 10:26:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.576s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:26:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:26:16 devstack sudo[78040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:26:16 devstack sudo[78040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:26:17 devstack sudo[78040]: pam_unix(sudo:session): session closed for user root Apr 29 10:26:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.581s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:26:17 devstack cinder-volume[75292]: DEBUG cinder.manager [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Notifying Schedulers of capabilities ... {{(pid=75292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:27:42 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:28:14 devstack cinder-volume[75292]: DEBUG oslo_service.periodic_task [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:28:14 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 10:28:14 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:14 devstack sudo[82558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 10:28:14 devstack sudo[82558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:15 devstack sudo[82558]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:15 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:15 devstack sudo[82645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:28:15 devstack sudo[82645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:16 devstack sudo[82645]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:16 devstack sudo[82671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 10:28:16 devstack sudo[82671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:16 devstack sudo[82671]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:16 devstack sudo[82719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 10:28:16 devstack sudo[82719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:17 devstack sudo[82719]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:17 devstack cinder-volume[75292]: DEBUG cinder.manager [None req-8a1ec6a4-c810-4e41-8004-bd6cec36e6b7 None None] Notifying Schedulers of capabilities ... {{(pid=75292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:28:19 devstack cinder-volume[75116]: INFO oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Caught SIGTERM, stopping children Apr 29 10:28:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.lockutils [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Acquiring lock "singleton_lock" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 10:28:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.lockutils [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Acquired lock "singleton_lock" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 10:28:19 devstack cinder-volume[75116]: DEBUG oslo_concurrency.lockutils [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Releasing lock "singleton_lock" {{(pid=75116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 10:28:19 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Stop services. {{(pid=75116) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 10:28:19 devstack cinder-volume[75116]: DEBUG oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Killing children. {{(pid=75116) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 10:28:19 devstack cinder-volume[75116]: INFO oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Waiting on 1 children to exit Apr 29 10:28:20 devstack cinder-volume[75292]: DEBUG oslo_concurrency.lockutils [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Acquiring lock "singleton_lock" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 10:28:20 devstack cinder-volume[75292]: DEBUG oslo_concurrency.lockutils [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Acquired lock "singleton_lock" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 10:28:20 devstack cinder-volume[75292]: DEBUG oslo_concurrency.lockutils [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Releasing lock "singleton_lock" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 10:28:20 devstack cinder-volume[75292]: WARNING amqp [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 10:28:20 devstack cinder-volume[75292]: WARNING amqp [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 10:28:20 devstack cinder-volume[75116]: INFO oslo_service.backend._eventlet.service [None req-3dd760ee-afaf-450b-8e95-16609c08327f None None] Child 75292 exited with status 0 Apr 29 10:28:22 devstack cinder-volume[82915]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82915) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 10:28:22 devstack cinder-volume[82915]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82915) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 10:28:22 devstack cinder-volume[82915]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82915) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 10:28:23 devstack cinder-volume[82915]: INFO dbcounter [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Registered counter for database cinder Apr 29 10:28:23 devstack cinder-volume[82915]: DEBUG oslo_db.sqlalchemy.engines [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82915) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG dbcounter [-] [82915] Writer thread running {{(pid=82915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 10:28:24 devstack cinder-volume[82915]: INFO cinder.rpc [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 10:28:24 devstack cinder-volume[82915]: INFO cinder.rpc [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_db.sqlalchemy.engines [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82915) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:28:24 devstack cinder-volume[82915]: INFO cinder.volume.manager [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Determined volume DB was empty at startup. Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG cinder.volume.manager [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82915) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 10:28:24 devstack cinder-volume[82915]: INFO cinder.volume.manager [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 10:28:24 devstack cinder-volume[82915]: WARNING stevedore.named [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 10:28:24 devstack cinder-volume[82915]: WARNING castellan.key_manager [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 10:28:24 devstack cinder-volume[82915]: WARNING cinder.keymgr.conf_key_mgr [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 10:28:24 devstack cinder-volume[82915]: INFO cinder.volume.manager [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_db.sqlalchemy.engines [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82915) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:28:24 devstack cinder-volume[82915]: INFO oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Starting 1 workers Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Started child 83194 {{(pid=82915) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Full set of CONF: {{(pid=82915) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] ******************************************************************************** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Configuration options gathered from: {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] ================================================================================ {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] allow_availability_zone_fallback = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[83194]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] allow_compression_on_image_upload = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] allowed_direct_url_schemes = [] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] api_rate_limit = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] auth_strategy = keystone {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_availability_zone = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_host = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_name = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_stats_polling_interval = 60 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backup_api_class = cinder.backup.api.API {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backup_name_template = backup-%s {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backup_use_same_host = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backup_use_temp_snapshot = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] chap_password = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] chap_username = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cinder_internal_tenant_project_id = af7ea8481a0f4f33a5a8c37ebe8b8517 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cinder_internal_tenant_user_id = 1d383f9621d94925ab8191c42265e525 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cluster = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] compression_format = gzip {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] compute_api_class = cinder.compute.nova.API {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] config_dir = [] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] config_source = [] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] control_exchange = openstack {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] debug = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] default_availability_zone = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] default_group_type = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] default_volume_type = QuobyteHD {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] disk_geometry = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] driver_client_cert = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] driver_client_cert_key = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] driver_data_namespace = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] driver_ssl_cert_path = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] driver_ssl_cert_verify = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] driver_use_ssl = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] enable_new_services = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] enable_unsupported_driver = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] enabled_backends = ['QuobyteHD'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] enforce_multipath_for_image_xfer = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] filter_function = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance_api_insecure = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance_api_servers = ['http://192.168.122.34/image'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance_api_ssl_compression = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance_ca_certificates_file = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance_catalog_info = image:glance:publicURL {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance_certfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance_keyfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance_num_retries = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance_request_timeout = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] goodness_function = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] graceful_shutdown_timeout = 5 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] group_api_class = cinder.group.api.API {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] host = devstack {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] image_compress_on_upload = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] image_conversion_address_space_limit = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] image_conversion_cpu_limit = 60 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[83194]: INFO cinder.volume.manager [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 10:28:24 devstack cinder-volume[83194]: DEBUG cinder.volume.drivers.remotefs [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83194) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] image_conversion_disable = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] image_upload_use_cinder_backend = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] image_upload_use_internal_tenant = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] image_volume_cache_enabled = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] image_volume_cache_max_count = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] image_volume_cache_max_size_gb = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] init_host_max_objects_retrieval = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] instance_format = [instance: %(uuid)s] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] iscsi_target_flags = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] iscsi_write_cache = on {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] iser_helper = tgtadm {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] iser_ip_address = 192.168.122.34 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] iser_port = 3260 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] log_color = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] log_config_append = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] log_dir = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] log_file = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] log_options = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] log_rotate_interval = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] log_rotate_interval_type = days {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] log_rotation_type = none {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] max_age = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] max_logfile_count = 30 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] max_logfile_size_mb = 200 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] max_over_subscription_ratio = 20.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] message_reap_interval = 86400 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] message_ttl = 2592000 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] migration_create_volume_timeout_secs = 300 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] monkey_patch = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] monkey_patch_modules = [] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] my_ip = 192.168.122.34 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] no_snapshot_gb_quota = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] num_iser_scan_tries = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] num_shell_tries = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] num_volume_device_scan_tries = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] nvmeof_conn_info_version = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] nvmet_ns_id = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] nvmet_port_id = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] osapi_max_limit = 1000 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] osapi_volume_ext_list = [] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] osapi_volume_listen_port = 8776 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] osapi_volume_use_ssl = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] osapi_volume_workers = 2 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] per_volume_size_limit = -1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] periodic_fuzzy_delay = 60 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] periodic_interval = 60 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] public_endpoint = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] publish_errors = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] quota_backup_gigabytes = 1000 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] quota_backups = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] quota_gigabytes = 1000 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] quota_groups = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] quota_snapshots = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] quota_volumes = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] rate_limit_burst = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] rate_limit_except_level = CRITICAL {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] rate_limit_interval = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] reinit_driver_count = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] replication_device = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] report_discard_supported = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] report_interval = 120 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] reservation_clean_interval = 86400 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] reservation_expire = 86400 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] reserved_image_namespaces = [] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] reserved_percentage = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] rpc_response_timeout = 120 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] run_external_periodic_tasks = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] scst_target_driver = iscsi {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] scst_target_iqn_name = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_down_time = 720 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] shell_completion = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] snapshot_name_template = snapshot-%s {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] split_loggers = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] state_path = /opt/stack/data/cinder {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] storage_availability_zone = nova {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] storage_protocol = iSCSI {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] syslog_log_facility = LOG_USER {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] target_helper = lioadm {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[83194]: DEBUG cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83194) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 10:28:24 devstack cinder-volume[83194]: WARNING cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 10:28:24 devstack cinder-volume[83194]: WARNING cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] target_ip_address = 192.168.122.34 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Running cmd (subprocess): mount.quobyte {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] target_port = 3260 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] target_protocol = iscsi {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] target_secondary_ip_addresses = [] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] trace_flags = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] transport_url = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] until_refresh = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] use_chap_auth = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] use_default_quota_class = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] use_journal = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] use_json = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] use_multipath_for_image_xfer = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] use_stderr = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] use_syslog = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] verify_glance_signatures = enabled {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_api_class = cinder.volume.api.API {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_backend_name = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_clear = zero {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_clear_ionice = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_clear_size = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_copy_bps_limit = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_dd_blocksize = 1M {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_name_template = volume-%s {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_service_inithost_offload = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volume_usage_audit_period = month {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] zoning_mode = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_concurrency.disable_process_locking = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.admin_password = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.admin_token = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.admin_user = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.auth_port = 35357 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.auth_protocol = https {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.auth_section = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.auth_type = password {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.auth_uri = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.auth_version = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.cache = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.certfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.identity_uri = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.include_service_catalog = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.insecure = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.interface = public {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.keyfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_password = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcache_username = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.region_name = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.service_type = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.backend = dogpile.cache.null {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.backend_argument = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.backend_expiration_time = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.config_prefix = cache.oslo {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.debug_cache_backend = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.enable_retry_client = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.enable_socket_keepalive = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.enabled = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack quobyte-client[83199]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.enforce_fips_mode = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.expiration_time = 600 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack quobyte-client[83199]: Invalid parameters found, error: missing mount point. Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.hashclient_retry_attempts = 2 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.memcache_dead_retry = 300 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack quobyte-client[83199]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 10:28:24 devstack quobyte-client[83199]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.memcache_pool_maxsize = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.memcache_sasl_enabled = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.password = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.proxies = [] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.redis_db = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[83194]: DEBUG cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83194) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.redis_server = localhost:6379 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[83194]: INFO cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 ... Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.retry_attempts = 2 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.retry_delay = 0.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 -c /etc/quobyte/client-cinder.cfg {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.socket_keepalive_count = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.socket_keepalive_idle = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.socket_keepalive_interval = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.socket_timeout = 1.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.tls_allowed_ciphers = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.tls_cafile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.tls_certfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.tls_enabled = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.tls_keyfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cache.username = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] coordination.backend_url = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.asyncio_connection = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.asyncio_slave_connection = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.backend = sqlalchemy {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.connection = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.connection_debug = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.connection_parameters = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.connection_recycle_time = 3600 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.connection_trace = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.db_inc_retry_interval = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.db_max_retries = 20 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.db_max_retry_interval = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.db_retry_interval = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.max_overflow = 50 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.max_pool_size = 5 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.max_retries = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.mysql_wsrep_sync_wait = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.pool_timeout = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.retry_interval = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.slave_connection = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.sqlite_synchronous = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.synchronous_reader = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] database.use_db_reconnect = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.connection_string = messaging:// {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.enabled = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.es_doc_type = notification {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.es_scroll_size = 10000 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.es_scroll_time = 2m {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.filter_error_trace = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.hmac_keys = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.sentinel_service_name = mymaster {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.socket_timeout = 0.1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.trace_requests = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler.trace_sqlalchemy = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler_jaeger.process_tags = {} {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler_jaeger.service_name_prefix = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] profiler_otlp.service_name_prefix = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.enforce_new_defaults = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: WARNING oslo_config.cfg [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.enforce_scope = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.policy_default_rule = default {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.policy_file = policy.yaml {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] privsep_osbrick.group = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] privsep_osbrick.helper_command = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] privsep_osbrick.user = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack sudo[83201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 -c /etc/quobyte/client-cinder.cfg Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cinder_sys_admin.group = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cinder_sys_admin.helper_command = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack sudo[83201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] cinder_sys_admin.user = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_user.auth_section = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_user.auth_type = password {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_user.cafile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_user.certfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_user.collect_timing = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_user.insecure = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_user.keyfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_user.send_service_user_token = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_user.split_loggers = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] service_user.timeout = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance.auth_section = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance.auth_type = password {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance.certfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance.collect_timing = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance.insecure = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance.keyfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance.region_name = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance.split_loggers = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] glance.timeout = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.backend_availability_zone = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.chap_password = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.chap_username = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.disk_geometry = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.driver_client_cert = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.driver_client_cert_key = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.driver_data_namespace = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.driver_use_ssl = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.extra_capabilities = {} {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.filter_function = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.goodness_function = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.iscsi_target_flags = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.iscsi_write_cache = on {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.iser_helper = tgtadm {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.iser_port = 3260 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nas_host = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nas_login = admin {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nas_mount_options = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nas_password = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nas_private_key = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nas_share_path = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.num_shell_tries = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.quobyte_volume_url = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.replication_device = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.report_discard_supported = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.reserved_percentage = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.target_helper = tgtadm {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.target_port = 3260 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.target_protocol = iscsi {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.trace_flags = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.unique_fqdn_network = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.use_chap_auth = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.volume_backend_name = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.volume_clear = zero {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.volume_clear_ionice = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.volume_clear_size = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_reports.file_event_handler = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_reports.log_dir = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.backend_availability_zone = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.backend_host = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.chap_password = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.chap_username = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.chiscsi_conf = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.disk_geometry = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.driver_client_cert = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.driver_data_namespace = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.driver_use_ssl = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.extra_capabilities = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.filter_function = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.goodness_function = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.iser_helper = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.iser_ip_address = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.iser_port = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.iser_target_prefix = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nas_host = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nas_login = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nas_mount_options = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nas_password = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nas_private_key = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nas_share_path = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nas_ssh_port = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.num_shell_tries = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.nvmet_port_id = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.replication_device = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.report_discard_supported = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.reserved_percentage = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.scst_target_driver = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.storage_protocol = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.target_helper = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.target_ip_address = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.target_port = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.target_prefix = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.target_protocol = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.trace_flags = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.use_chap_auth = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.volume_clear = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.volume_clear_size = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] QuobyteHD.volumes_dir = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.ssl = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_notifications.driver = [] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_notifications.retry = -1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] key_manager.fixed_key = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.barbican_api_version = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.barbican_endpoint = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.barbican_endpoint_type = public {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.barbican_region_name = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.cafile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.certfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.collect_timing = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.insecure = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.keyfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.number_of_retries = 60 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.retry_delay = 1 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.send_service_user_token = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.split_loggers = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.timeout = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.verify_ssl = True {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican.verify_ssl_path = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican_service_user.auth_section = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican_service_user.auth_type = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican_service_user.cafile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican_service_user.certfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican_service_user.collect_timing = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican_service_user.insecure = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican_service_user.keyfile = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican_service_user.split_loggers = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] barbican_service_user.timeout = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.approle_role_id = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.approle_secret_id = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.kv_mountpoint = secret {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.kv_path = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.kv_version = 2 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.namespace = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.root_token_id = **** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.ssl_ca_crt_file = None {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.timeout = 60.0 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.use_ssl = False {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:24 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] ******************************************************************************** {{(pid=82915) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 10:28:25 devstack sudo[83201]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:25 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.782s {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:25 devstack cinder-volume[83194]: INFO cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 succeeded Apr 29 10:28:25 devstack cinder-volume[83194]: DEBUG cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83194) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:28:25 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.801s {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:28:25 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:25 devstack sudo[83287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:28:25 devstack sudo[83287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:26 devstack sudo[83287]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.709s {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:26 devstack cinder-volume[83194]: INFO cinder.volume.driver [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Driver hasn't implemented _init_vendor_properties() Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG cinder.volume.driver [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.677001953125, 'free_capacity_gb': 1775.677001953125, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83194) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG oslo_db.sqlalchemy.engines [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG dbcounter [-] [83194] Writer thread running {{(pid=83194) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG cinder.db.sqlalchemy.api [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Building query based on filter {{(pid=83194) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG cinder.image.image_utils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83194) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 10:28:26 devstack cinder-volume[83194]: INFO cinder.keymgr.migration [None req-aae4adf5-f9e6-4e05-9016-444ad2d1051e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83194) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83194) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:28:26 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:26 devstack sudo[83309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:28:26 devstack sudo[83309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:27 devstack sudo[83309]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:27 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.981s {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:27 devstack cinder-volume[83194]: DEBUG cinder.manager [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Notifying Schedulers of capabilities ... {{(pid=83194) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:28:27 devstack cinder-volume[83194]: INFO cinder.volume.manager [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Driver initialization completed successfully. Apr 29 10:28:27 devstack cinder-volume[83194]: INFO cinder.manager [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Initiating service 3 cleanup Apr 29 10:28:27 devstack cinder-volume[83194]: INFO cinder.manager [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Service 3 cleanup completed. Apr 29 10:28:27 devstack cinder-volume[83194]: DEBUG cinder.service [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Creating RPC server for service cinder-volume {{(pid=83194) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 10:28:27 devstack cinder-volume[83194]: DEBUG cinder.service [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83194) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 10:28:27 devstack cinder-volume[83194]: INFO cinder.volume.manager [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 10:28:27 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:28:27 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:28:27 devstack cinder-volume[83194]: DEBUG cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83194) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:28:27 devstack cinder-volume[83194]: DEBUG cinder.volume.drivers.quobyte [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83194) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:28:27 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:28:27 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:27 devstack sudo[83444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:28:27 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:28 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:28 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.735s {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:28 devstack cinder-volume[83194]: INFO cinder.volume.manager [None req-ca2bcef5-ac11-4dc9-b663-06c142c4af4a None None] Driver post RPC initialization completed successfully. Apr 29 10:28:30 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-a1837bf7-6984-4b39-bc16-d70acbbb6ec0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:28:30 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-a1837bf7-6984-4b39-bc16-d70acbbb6ec0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:28:30 devstack cinder-volume[83194]: DEBUG cinder.volume.drivers.quobyte [None req-a1837bf7-6984-4b39-bc16-d70acbbb6ec0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83194) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:28:30 devstack cinder-volume[83194]: DEBUG cinder.volume.drivers.quobyte [None req-a1837bf7-6984-4b39-bc16-d70acbbb6ec0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83194) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:28:30 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-a1837bf7-6984-4b39-bc16-d70acbbb6ec0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:28:30 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-a1837bf7-6984-4b39-bc16-d70acbbb6ec0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:30 devstack sudo[83476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:28:30 devstack sudo[83476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:31 devstack sudo[83476]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:31 devstack cinder-volume[83194]: DEBUG oslo_concurrency.processutils [None req-a1837bf7-6984-4b39-bc16-d70acbbb6ec0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.547s {{(pid=83194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:31 devstack cinder-volume[83194]: DEBUG cinder.manager [None req-a1837bf7-6984-4b39-bc16-d70acbbb6ec0 None None] Notifying Schedulers of capabilities ... {{(pid=83194) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:28:32 devstack cinder-volume[82915]: INFO oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Caught SIGTERM, stopping children Apr 29 10:28:32 devstack cinder-volume[82915]: DEBUG oslo_concurrency.lockutils [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Acquiring lock "singleton_lock" {{(pid=82915) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 10:28:32 devstack cinder-volume[82915]: DEBUG oslo_concurrency.lockutils [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Acquired lock "singleton_lock" {{(pid=82915) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 10:28:32 devstack cinder-volume[82915]: DEBUG oslo_concurrency.lockutils [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Releasing lock "singleton_lock" {{(pid=82915) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 10:28:32 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Stop services. {{(pid=82915) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 10:28:32 devstack cinder-volume[82915]: DEBUG oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Killing children. {{(pid=82915) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 10:28:32 devstack cinder-volume[82915]: INFO oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Waiting on 1 children to exit Apr 29 10:28:36 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Acquiring lock "singleton_lock" {{(pid=83194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 10:28:36 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Acquired lock "singleton_lock" {{(pid=83194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 10:28:36 devstack cinder-volume[83194]: DEBUG oslo_concurrency.lockutils [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Releasing lock "singleton_lock" {{(pid=83194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 10:28:36 devstack cinder-volume[83194]: WARNING amqp [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 10:28:36 devstack cinder-volume[83194]: WARNING amqp [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 10:28:36 devstack cinder-volume[82915]: INFO oslo_service.backend._eventlet.service [None req-702e58de-1b43-4c06-a8d8-336326a93fd4 None None] Child 83194 exited with status 0 Apr 29 10:28:39 devstack cinder-volume[83550]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83550) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 10:28:39 devstack cinder-volume[83550]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83550) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 10:28:39 devstack cinder-volume[83550]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83550) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 10:28:40 devstack cinder-volume[83550]: INFO dbcounter [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Registered counter for database cinder Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_db.sqlalchemy.engines [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83550) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG dbcounter [-] [83550] Writer thread running {{(pid=83550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 10:28:40 devstack cinder-volume[83550]: INFO cinder.rpc [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 10:28:40 devstack cinder-volume[83550]: INFO cinder.rpc [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_db.sqlalchemy.engines [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83550) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:28:40 devstack cinder-volume[83550]: INFO cinder.volume.manager [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Determined volume DB was empty at startup. Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG cinder.volume.manager [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83550) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 10:28:40 devstack cinder-volume[83550]: WARNING stevedore.named [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 10:28:40 devstack cinder-volume[83550]: WARNING castellan.key_manager [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 10:28:40 devstack cinder-volume[83550]: WARNING cinder.keymgr.conf_key_mgr [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 10:28:40 devstack cinder-volume[83550]: INFO cinder.volume.manager [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_db.sqlalchemy.engines [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83550) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:28:40 devstack cinder-volume[83550]: INFO oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Starting 1 workers Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Started child 83806 {{(pid=83550) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Full set of CONF: {{(pid=83550) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] ******************************************************************************** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Configuration options gathered from: {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] ================================================================================ {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] allow_availability_zone_fallback = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] allow_compression_on_image_upload = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] allowed_direct_url_schemes = [] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] api_rate_limit = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] auth_strategy = keystone {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_availability_zone = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_host = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83806]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_name = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_stats_polling_interval = 60 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backup_api_class = cinder.backup.api.API {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backup_name_template = backup-%s {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backup_use_same_host = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backup_use_temp_snapshot = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] chap_password = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] chap_username = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cinder_internal_tenant_project_id = af7ea8481a0f4f33a5a8c37ebe8b8517 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cinder_internal_tenant_user_id = 1d383f9621d94925ab8191c42265e525 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cluster = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] compression_format = gzip {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] compute_api_class = cinder.compute.nova.API {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] config_dir = [] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] config_source = [] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] control_exchange = openstack {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] debug = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] default_availability_zone = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] default_group_type = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] default_volume_type = QuobyteHD {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] disk_geometry = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] driver_client_cert = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] driver_client_cert_key = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] driver_data_namespace = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] driver_ssl_cert_path = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] driver_ssl_cert_verify = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] driver_use_ssl = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] enable_new_services = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] enable_unsupported_driver = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] enabled_backends = ['QuobyteHD'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] enforce_multipath_for_image_xfer = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] filter_function = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance_api_insecure = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance_api_servers = ['http://192.168.122.34/image'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance_api_ssl_compression = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance_ca_certificates_file = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance_catalog_info = image:glance:publicURL {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance_certfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance_keyfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance_num_retries = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance_request_timeout = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] goodness_function = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] graceful_shutdown_timeout = 5 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] group_api_class = cinder.group.api.API {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] host = devstack {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] image_compress_on_upload = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] image_conversion_address_space_limit = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] image_conversion_cpu_limit = 60 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] image_conversion_disable = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] image_upload_use_cinder_backend = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] image_upload_use_internal_tenant = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] image_volume_cache_enabled = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] image_volume_cache_max_count = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] image_volume_cache_max_size_gb = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] init_host_max_objects_retrieval = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] instance_format = [instance: %(uuid)s] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] iscsi_target_flags = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] iscsi_write_cache = on {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] iser_helper = tgtadm {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] iser_ip_address = 192.168.122.34 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] iser_port = 3260 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] log_color = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] log_config_append = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] log_dir = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] log_file = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] log_options = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] log_rotate_interval = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] log_rotate_interval_type = days {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] log_rotation_type = none {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] max_age = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] max_logfile_count = 30 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] max_logfile_size_mb = 200 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] max_over_subscription_ratio = 20.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] message_reap_interval = 86400 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] message_ttl = 2592000 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] migration_create_volume_timeout_secs = 300 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] monkey_patch = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] monkey_patch_modules = [] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] my_ip = 192.168.122.34 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] no_snapshot_gb_quota = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] num_iser_scan_tries = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] num_shell_tries = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] num_volume_device_scan_tries = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] nvmeof_conn_info_version = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] nvmet_ns_id = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] nvmet_port_id = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] osapi_max_limit = 1000 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] osapi_volume_ext_list = [] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] osapi_volume_listen_port = 8776 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] osapi_volume_use_ssl = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] osapi_volume_workers = 2 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] per_volume_size_limit = -1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] periodic_fuzzy_delay = 60 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] periodic_interval = 60 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] public_endpoint = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] publish_errors = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] quota_backup_gigabytes = 1000 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] quota_backups = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] quota_gigabytes = 1000 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] quota_groups = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] quota_snapshots = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] quota_volumes = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] rate_limit_burst = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] rate_limit_except_level = CRITICAL {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] rate_limit_interval = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] reinit_driver_count = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] replication_device = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] report_discard_supported = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] report_interval = 120 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] reservation_clean_interval = 86400 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] reservation_expire = 86400 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] reserved_image_namespaces = [] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] reserved_percentage = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] rpc_response_timeout = 120 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83806) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] run_external_periodic_tasks = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] scst_target_driver = iscsi {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] scst_target_iqn_name = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_down_time = 720 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] shell_completion = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] snapshot_name_template = snapshot-%s {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] split_loggers = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] state_path = /opt/stack/data/cinder {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] storage_availability_zone = nova {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] storage_protocol = iSCSI {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] syslog_log_facility = LOG_USER {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] target_helper = lioadm {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] target_ip_address = 192.168.122.34 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] target_port = 3260 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] target_protocol = iscsi {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] target_secondary_ip_addresses = [] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] trace_flags = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] transport_url = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] until_refresh = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] use_chap_auth = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] use_default_quota_class = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] use_journal = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] use_json = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] use_multipath_for_image_xfer = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] use_stderr = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] use_syslog = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] verify_glance_signatures = enabled {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_api_class = cinder.volume.api.API {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_backend_name = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_clear = zero {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_clear_ionice = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_clear_size = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_copy_bps_limit = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_dd_blocksize = 1M {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_name_template = volume-%s {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_service_inithost_offload = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volume_usage_audit_period = month {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] zoning_mode = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_concurrency.disable_process_locking = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.admin_password = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.admin_token = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.admin_user = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.auth_port = 35357 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.auth_protocol = https {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.auth_section = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.auth_type = password {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.auth_uri = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.auth_version = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.cache = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.certfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.identity_uri = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.include_service_catalog = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.insecure = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.interface = public {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.keyfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_password = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcache_username = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.region_name = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.service_type = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.backend = dogpile.cache.null {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.backend_argument = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.backend_expiration_time = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.config_prefix = cache.oslo {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.debug_cache_backend = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.enable_retry_client = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.enable_socket_keepalive = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.enabled = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.enforce_fips_mode = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.expiration_time = 600 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.hashclient_retry_attempts = 2 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.memcache_dead_retry = 300 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.memcache_pool_maxsize = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.memcache_sasl_enabled = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.password = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.proxies = [] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.redis_db = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.redis_server = localhost:6379 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.retry_attempts = 2 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.retry_delay = 0.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.socket_keepalive_count = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.socket_keepalive_idle = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.socket_keepalive_interval = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.socket_timeout = 1.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.tls_allowed_ciphers = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.tls_cafile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.tls_certfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.tls_enabled = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.tls_keyfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cache.username = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] coordination.backend_url = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.asyncio_connection = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.asyncio_slave_connection = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.backend = sqlalchemy {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.connection = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.connection_debug = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.connection_parameters = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.connection_recycle_time = 3600 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.connection_trace = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.db_inc_retry_interval = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.db_max_retries = 20 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.db_max_retry_interval = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.db_retry_interval = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.max_overflow = 50 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.max_pool_size = 5 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.max_retries = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.mysql_wsrep_sync_wait = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.pool_timeout = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.retry_interval = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.slave_connection = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.sqlite_synchronous = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.synchronous_reader = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] database.use_db_reconnect = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.connection_string = messaging:// {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.enabled = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.es_doc_type = notification {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.es_scroll_size = 10000 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.es_scroll_time = 2m {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.filter_error_trace = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.hmac_keys = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.sentinel_service_name = mymaster {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.socket_timeout = 0.1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.trace_requests = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler.trace_sqlalchemy = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler_jaeger.process_tags = {} {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler_jaeger.service_name_prefix = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] profiler_otlp.service_name_prefix = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.enforce_new_defaults = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: WARNING oslo_config.cfg [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.enforce_scope = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.policy_default_rule = default {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.policy_file = policy.yaml {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] privsep_osbrick.group = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] privsep_osbrick.helper_command = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] privsep_osbrick.user = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cinder_sys_admin.group = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cinder_sys_admin.helper_command = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] cinder_sys_admin.user = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_user.auth_section = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_user.auth_type = password {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_user.cafile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_user.certfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_user.collect_timing = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_user.insecure = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_user.keyfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_user.send_service_user_token = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_user.split_loggers = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] service_user.timeout = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance.auth_section = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance.auth_type = password {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance.certfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance.collect_timing = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance.insecure = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance.keyfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance.region_name = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance.split_loggers = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] glance.timeout = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.backend_availability_zone = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.chap_password = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.chap_username = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.disk_geometry = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.driver_client_cert = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.driver_client_cert_key = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.driver_data_namespace = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.driver_use_ssl = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.extra_capabilities = {} {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.filter_function = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.goodness_function = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.iscsi_target_flags = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.iscsi_write_cache = on {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.iser_helper = tgtadm {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.iser_port = 3260 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nas_host = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nas_login = admin {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nas_mount_options = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nas_password = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nas_private_key = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nas_share_path = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.num_shell_tries = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83806) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 10:28:40 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.quobyte [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.quobyte_volume_url = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.replication_device = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.report_discard_supported = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.reserved_percentage = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.target_helper = tgtadm {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.quobyte [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.target_port = 3260 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.target_protocol = iscsi {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.trace_flags = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Running cmd (subprocess): mount.quobyte {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.unique_fqdn_network = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.use_chap_auth = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.volume_backend_name = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.volume_clear = zero {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.volume_clear_ionice = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.volume_clear_size = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_reports.file_event_handler = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_reports.log_dir = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.backend_availability_zone = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.backend_host = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.chap_password = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.chap_username = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.chiscsi_conf = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.disk_geometry = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.driver_client_cert = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.driver_data_namespace = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.driver_use_ssl = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.extra_capabilities = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.filter_function = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.goodness_function = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.iser_helper = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.iser_ip_address = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.iser_port = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.iser_target_prefix = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nas_host = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nas_login = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nas_mount_options = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nas_password = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nas_private_key = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nas_share_path = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nas_ssh_port = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.num_shell_tries = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.nvmet_port_id = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.replication_device = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.report_discard_supported = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.reserved_percentage = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.scst_target_driver = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.storage_protocol = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.target_helper = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.target_ip_address = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.target_port = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.target_prefix = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.target_protocol = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.trace_flags = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.use_chap_auth = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.volume_clear = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.volume_clear_size = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] QuobyteHD.volumes_dir = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.ssl = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_notifications.driver = [] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_notifications.retry = -1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] key_manager.fixed_key = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.barbican_api_version = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.barbican_endpoint = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.barbican_endpoint_type = public {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.barbican_region_name = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.cafile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.certfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.collect_timing = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.insecure = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.keyfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.number_of_retries = 60 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.retry_delay = 1 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.send_service_user_token = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.split_loggers = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.timeout = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.verify_ssl = True {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican.verify_ssl_path = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican_service_user.auth_section = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican_service_user.auth_type = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican_service_user.cafile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican_service_user.certfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican_service_user.collect_timing = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican_service_user.insecure = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican_service_user.keyfile = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican_service_user.split_loggers = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] barbican_service_user.timeout = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.approle_role_id = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.approle_secret_id = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.kv_mountpoint = secret {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.kv_path = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.kv_version = 2 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.namespace = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.root_token_id = **** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.ssl_ca_crt_file = None {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.timeout = 60.0 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.use_ssl = False {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 10:28:40 devstack cinder-volume[83550]: DEBUG oslo_service.backend._eventlet.service [None req-0bd72250-2bc2-43e3-9825-56462e73e8b6 None None] ******************************************************************************** {{(pid=83550) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 10:28:41 devstack quobyte-client[83807]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 10:28:41 devstack quobyte-client[83807]: Invalid parameters found, error: missing mount point. Apr 29 10:28:41 devstack quobyte-client[83807]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 10:28:41 devstack quobyte-client[83807]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:41 devstack sudo[83808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:28:41 devstack sudo[83808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:41 devstack sudo[83808]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.593s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:41 devstack cinder-volume[83806]: INFO cinder.volume.driver [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG cinder.volume.driver [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6770401000977, 'free_capacity_gb': 1775.6770401000977, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83806) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_db.sqlalchemy.engines [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83806) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writer thread running {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG cinder.db.sqlalchemy.api [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Building query based on filter {{(pid=83806) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83806) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:28:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:41 devstack cinder-volume[83806]: INFO cinder.keymgr.migration [None req-18f52761-dfff-4aeb-98aa-3d95be6f38b3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 10:28:41 devstack sudo[83811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:28:41 devstack sudo[83811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:42 devstack sudo[83811]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.576s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:42 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:28:42 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Driver initialization completed successfully. Apr 29 10:28:42 devstack cinder-volume[83806]: INFO cinder.manager [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Initiating service 3 cleanup Apr 29 10:28:42 devstack cinder-volume[83806]: INFO cinder.manager [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Service 3 cleanup completed. Apr 29 10:28:42 devstack cinder-volume[83806]: DEBUG cinder.service [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Creating RPC server for service cinder-volume {{(pid=83806) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 10:28:42 devstack cinder-volume[83806]: DEBUG cinder.service [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83806) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 10:28:42 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 10:28:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:28:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:28:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:28:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:28:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:28:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:28:42 devstack sudo[83816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:28:42 devstack sudo[83816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:28:43 devstack sudo[83816]: pam_unix(sudo:session): session closed for user root Apr 29 10:28:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.639s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:28:43 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-cb687fa4-421a-4972-88dc-264ae9acf8f7 None None] Driver post RPC initialization completed successfully. Apr 29 10:28:50 devstack cinder-volume[83550]: DEBUG dbcounter [-] [83550] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:28:52 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:28:53 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=2 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:29:47 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Flow 'volume_create_manager' (422ca9d5-82bd-413f-8144-751d4b2f2479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5ab517-88c4-4092-92a8-b995f3d87164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5ab517-88c4-4092-92a8-b995f3d87164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1077870811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af12b2d9-947c-4c8a-bf34-70f6c09e1460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f44be0b7ae8478ebe9abd09010ee13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:48Z,use_quota=True,user_id='ce2fb32cab4b4c218f77fe4beda1656c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb47ae5-4d26-4ce2-ae46-c21d57556df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb47ae5-4d26-4ce2-ae46-c21d57556df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837da872-cc6b-4108-8749-46f106c2d44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837da872-cc6b-4108-8749-46f106c2d44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af12b2d9-947c-4c8a-bf34-70f6c09e1460', 'volume_name': 'volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00276ae-ba5c-44ef-b7b0-47f8d7009764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00276ae-ba5c-44ef-b7b0-47f8d7009764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07961dcf-e56a-4b2c-96ee-83226eddb124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:29:48 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Volume af12b2d9-947c-4c8a-bf34-70f6c09e1460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460', 'volume_size': 1} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1077870811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af12b2d9-947c-4c8a-bf34-70f6c09e1460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f44be0b7ae8478ebe9abd09010ee13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:29:48Z,use_quota=True,user_id='ce2fb32cab4b4c218f77fe4beda1656c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Creating volume af12b2d9-947c-4c8a-bf34-70f6c09e1460 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:29:48 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:29:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:29:48 devstack sudo[84403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 1073741824 Apr 29 10:29:48 devstack sudo[84403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:29:50 devstack sudo[84403]: pam_unix(sudo:session): session closed for user root Apr 29 10:29:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 1073741824" returned: 0 in 2.182s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:29:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:29:50 devstack sudo[84769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 Apr 29 10:29:50 devstack sudo[84769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:29:51 devstack sudo[84769]: pam_unix(sudo:session): session closed for user root Apr 29 10:29:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460" returned: 0 in 1.210s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:29:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] <== create_volume: return (3533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:29:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.547s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:29:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07961dcf-e56a-4b2c-96ee-83226eddb124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:29:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed03de2a-3fc7-4716-bba2-0b28dd4fbfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:29:51 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Volume volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 (af12b2d9-947c-4c8a-bf34-70f6c09e1460): created successfully Apr 29 10:29:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed03de2a-3fc7-4716-bba2-0b28dd4fbfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:29:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Flow 'volume_create_manager' (422ca9d5-82bd-413f-8144-751d4b2f2479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:29:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-a5c6f27c-769e-4dec-ad12-b972e46b7317 tempest-DeleteServersTestJSON-1652005174 None] Created volume successfully. Apr 29 10:30:01 devstack cinder-volume[83806]: WARNING py.warnings [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 29 10:30:01 devstack cinder-volume[83806]: .first() Apr 29 10:30:01 devstack cinder-volume[83806]: Apr 29 10:30:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:01 devstack cinder-volume[83806]: INFO oslo.privsep.daemon [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpclhk0yje/privsep.sock'] Apr 29 10:30:01 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpclhk0yje/privsep.sock Apr 29 10:30:01 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:01 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:30:05 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:05 devstack cinder-volume[83806]: INFO oslo.privsep.daemon [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] Spawned new privsep daemon via rootwrap Apr 29 10:30:05 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] Accepted privsep connection to /tmp/tmpclhk0yje/privsep.sock {{(pid=83806) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 10:30:05 devstack cinder-volume[83806]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 10:30:05 devstack cinder-volume[83806]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 10:30:05 devstack cinder-volume[83806]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 10:30:05 devstack cinder-volume[83806]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84960 Apr 29 10:30:05 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[583437df-95f0-49c7-b6de-f5ac53670d77]: (2,) {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:30:05 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26778ce-5558-4ff4-9d89-9266b6c536c2]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:30:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:05 devstack sudo[84963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 Apr 29 10:30:05 devstack sudo[84963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Flow 'volume_create_manager' (a9bee951-ccdf-4cde-a3d1-2f825bb073eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbdea19-6895-4bf5-8636-869449c01cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbdea19-6895-4bf5-8636-869449c01cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-423961817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f334c9-0530-4cc7-ac64-72da893d0166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2ac01c6f424bc1aaf09bac15b9cdab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:06Z,use_quota=True,user_id='d29bc70befd942c0a2741842649091ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05adfb81-b69b-4b68-8e17-102c7c9ea7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05adfb81-b69b-4b68-8e17-102c7c9ea7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f85d8e-86f0-40c0-9942-0dc26803c976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f85d8e-86f0-40c0-9942-0dc26803c976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f334c9-0530-4cc7-ac64-72da893d0166', 'volume_name': 'volume-d0f334c9-0530-4cc7-ac64-72da893d0166', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab903f19-c533-4029-856c-f71840106518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab903f19-c533-4029-856c-f71840106518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e3da18-54b5-4d9c-9fa6-839c255f6576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:06 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Volume d0f334c9-0530-4cc7-ac64-72da893d0166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f334c9-0530-4cc7-ac64-72da893d0166', 'volume_size': 1} Apr 29 10:30:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:07 devstack sudo[84963]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460" returned: 0 in 2.337s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 6.187s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.184s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-423961817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f334c9-0530-4cc7-ac64-72da893d0166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2ac01c6f424bc1aaf09bac15b9cdab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:06Z,use_quota=True,user_id='d29bc70befd942c0a2741842649091ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Creating volume d0f334c9-0530-4cc7-ac64-72da893d0166 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:30:07 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:30:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:07 devstack sudo[84977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166 1073741824 Apr 29 10:30:07 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9', 'name': 'volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0eb0e70-cf0b-44e7-8731-be2e7a47257c', 'enforce_multipath': True} {{(pid=83806) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 10:30:08 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-90c74561-b3a5-4575-b0fa-0358880c9a61 req-14bc3cb8-0c9c-4a5f-ab1c-e2b89b633427 tempest-DeleteServersTestJSON-1652005174 None] attachment_update completed successfully. Apr 29 10:30:09 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166 1073741824" returned: 0 in 2.055s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:10 devstack sudo[85075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166 Apr 29 10:30:10 devstack sudo[85075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:11 devstack sudo[85075]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166" returned: 0 in 1.625s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] <== create_volume: return (3785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:30:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.793s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e3da18-54b5-4d9c-9fa6-839c255f6576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f334c9-0530-4cc7-ac64-72da893d0166', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cdc6552-f743-4d2e-b727-c506f176d79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:11 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Volume volume-d0f334c9-0530-4cc7-ac64-72da893d0166 (d0f334c9-0530-4cc7-ac64-72da893d0166): created successfully Apr 29 10:30:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cdc6552-f743-4d2e-b727-c506f176d79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Flow 'volume_create_manager' (a9bee951-ccdf-4cde-a3d1-2f825bb073eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:30:11 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-3f2975c0-fd4b-4bb6-b68e-d8e3c46a0f35 tempest-ServerRescueNegativeTestJSON-212108096 None] Created volume successfully. Apr 29 10:30:20 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-7738ea6c-5f8c-48ec-a107-ccef1f5ecd40 req-0a1cac21-5708-4e52-9481-c0ed4df81391 tempest-DeleteServersTestJSON-1652005174 None] Terminate volume connection completed successfully. Apr 29 10:30:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-7738ea6c-5f8c-48ec-a107-ccef1f5ecd40 req-0a1cac21-5708-4e52-9481-c0ed4df81391 tempest-DeleteServersTestJSON-1652005174 None] Deleting attachment e0eb0e70-cf0b-44e7-8731-be2e7a47257c. {{(pid=83806) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 10:30:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Acquiring lock "cinder-af12b2d9-947c-4c8a-bf34-70f6c09e1460-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:30:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Lock "cinder-af12b2d9-947c-4c8a-bf34-70f6c09e1460-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:30:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Acquiring lock "cinder-quobyte-af12b2d9-947c-4c8a-bf34-70f6c09e1460" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:30:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Lock "cinder-quobyte-af12b2d9-947c-4c8a-bf34-70f6c09e1460" acquired by "delete_volume" :: waited 0.037s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:30:28 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe981a0-bbe6-43f6-a7f4-0f9c995bb184]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:30:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:28 devstack sudo[85646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 Apr 29 10:30:28 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:29 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460" returned: 0 in 1.260s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:29 devstack sudo[85653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460 Apr 29 10:30:29 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:30 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-af12b2d9-947c-4c8a-bf34-70f6c09e1460" returned: 0 in 1.096s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Lock "cinder-quobyte-af12b2d9-947c-4c8a-bf34-70f6c09e1460" released by "delete_volume" :: held 2.417s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:30:30 devstack cinder-volume[83806]: WARNING cinder.quota [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:30:30 devstack cinder-volume[83806]: WARNING cinder.quota [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:30:31 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Created reservations ['3dc9a8f0-78e8-4642-a541-333e022430e3', 'ef1d7ef1-3fcb-4e5b-881c-7f2795f9277a', 'ea2ed008-d995-4579-8a16-bf8ca9641164', '762b1644-0627-44ef-90dc-d66c950424cf'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:30:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:30:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:30:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:31 devstack sudo[85657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:30:31 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:32 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.362s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:32 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:30:32 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Deleted volume successfully. Apr 29 10:30:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28472807-9d9c-4935-8452-54fc4ecd909d tempest-DeleteServersTestJSON-1652005174 None] Lock "cinder-af12b2d9-947c-4c8a-bf34-70f6c09e1460-delete_volume" released by "delete_volume" :: held 4.464s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:30:32 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:30:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Flow 'volume_create_manager' (7e47c41c-a93f-48d4-b7f0-e5f77006a0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:30:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d39a5a-cd1d-4b4b-991f-7f47cb3bcb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d39a5a-cd1d-4b4b-991f-7f47cb3bcb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:30:32Z,deleted=False,deleted_at=None,display_description='',display_name='14e39e55-cf02-462c-b25c-98239c2c5161-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47786162-84af-4d4c-bf94-742d19976b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273577868c6941fb8f9ddcf6f83a75aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:33Z,use_quota=True,user_id='51cd9fd92ad24bd68ba442d22392cd8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cb21fc-27d6-48b7-804d-74b17740224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cb21fc-27d6-48b7-804d-74b17740224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e272692c-356e-4ddc-b9e0-92e37b71c6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e272692c-356e-4ddc-b9e0-92e37b71c6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47786162-84af-4d4c-bf94-742d19976b7c', 'volume_name': 'volume-47786162-84af-4d4c-bf94-742d19976b7c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbb657d-fa30-4648-a304-12e8890750e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbb657d-fa30-4648-a304-12e8890750e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910922f4-f4e9-4865-b80c-a77c0a00fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:33 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Volume 47786162-84af-4d4c-bf94-742d19976b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47786162-84af-4d4c-bf94-742d19976b7c', 'volume_size': 1} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:30:32Z,deleted=False,deleted_at=None,display_description='',display_name='14e39e55-cf02-462c-b25c-98239c2c5161-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47786162-84af-4d4c-bf94-742d19976b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273577868c6941fb8f9ddcf6f83a75aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:33Z,use_quota=True,user_id='51cd9fd92ad24bd68ba442d22392cd8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Creating volume 47786162-84af-4d4c-bf94-742d19976b7c {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:30:33 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:33 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c 1073741824 Apr 29 10:30:33 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:33 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:30:33 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:34 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c 1073741824" returned: 0 in 1.192s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:34 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.157s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:34 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:30:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:34 devstack sudo[85669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c Apr 29 10:30:34 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:35 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c" returned: 0 in 1.064s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:30:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910922f4-f4e9-4865-b80c-a77c0a00fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47786162-84af-4d4c-bf94-742d19976b7c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f7ed9a-d9f6-4e9b-bd59-57f24a0636aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:35 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Volume volume-47786162-84af-4d4c-bf94-742d19976b7c (47786162-84af-4d4c-bf94-742d19976b7c): created successfully Apr 29 10:30:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f7ed9a-d9f6-4e9b-bd59-57f24a0636aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Flow 'volume_create_manager' (7e47c41c-a93f-48d4-b7f0-e5f77006a0a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:30:35 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-2dbd11e5-2f5a-4c81-8c66-a9d35db6d24f tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Created volume successfully. Apr 29 10:30:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-790349d7-d642-4432-a5be-8b74a8900804 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-790349d7-d642-4432-a5be-8b74a8900804 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:36 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[9511ee6c-6f97-4516-8e3b-2c63709c2215]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:30:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-790349d7-d642-4432-a5be-8b74a8900804 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:36 devstack sudo[85691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c Apr 29 10:30:36 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:37 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-790349d7-d642-4432-a5be-8b74a8900804 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c" returned: 0 in 1.040s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-790349d7-d642-4432-a5be-8b74a8900804 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.074s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-790349d7-d642-4432-a5be-8b74a8900804 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9', 'name': 'volume-47786162-84af-4d4c-bf94-742d19976b7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '147abab2-d05b-4e77-b238-d87dfb323271', 'enforce_multipath': True} {{(pid=83806) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 10:30:37 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-cdbe86d8-ed14-4e1a-aed3-b385c51bbb74 req-790349d7-d642-4432-a5be-8b74a8900804 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] attachment_update completed successfully. Apr 29 10:30:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Acquiring lock "cinder-d0f334c9-0530-4cc7-ac64-72da893d0166-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:30:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Lock "cinder-d0f334c9-0530-4cc7-ac64-72da893d0166-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:30:43 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=27,cinder:UPDATE=17,cinder:INSERT=3 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:30:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Acquiring lock "cinder-quobyte-d0f334c9-0530-4cc7-ac64-72da893d0166" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:30:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Lock "cinder-quobyte-d0f334c9-0530-4cc7-ac64-72da893d0166" acquired by "delete_volume" :: waited 0.031s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:30:43 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e8b7c1-b9e0-4f37-ad2b-cf9e6ff92057]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:30:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:43 devstack sudo[85763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166 Apr 29 10:30:43 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:44 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166" returned: 0 in 1.056s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:44 devstack sudo[85768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166 Apr 29 10:30:44 devstack sudo[85768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:44 devstack sudo[85768]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d0f334c9-0530-4cc7-ac64-72da893d0166" returned: 0 in 0.777s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Lock "cinder-quobyte-d0f334c9-0530-4cc7-ac64-72da893d0166" released by "delete_volume" :: held 1.901s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:30:45 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Created reservations ['beb95010-fbe4-4ab8-927f-7954daf440ea', '50604dfc-982f-4397-9bc0-9a2cce0d7c82', 'e8334a4c-8137-4294-ab06-4e42dd94b587', 'e66df53a-4219-4b1b-8742-685c07dd4a56'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:30:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:30:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:30:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:45 devstack sudo[85772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:30:45 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:47 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.832s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:47 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:30:47 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Deleted volume successfully. Apr 29 10:30:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-63acfea4-a72f-4be4-9667-9d5d4cb80a8f tempest-ServerRescueNegativeTestJSON-212108096 None] Lock "cinder-d0f334c9-0530-4cc7-ac64-72da893d0166-delete_volume" released by "delete_volume" :: held 4.158s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:30:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f34470ed-67dc-4cce-8549-cf1b4c342bca tempest-GroupSnapshotsTest-1922568388 None] Group tempest-GroupSnapshotsTest-Group-1820927012: creating Apr 29 10:30:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f34470ed-67dc-4cce-8549-cf1b4c342bca tempest-GroupSnapshotsTest-1922568388 None] Group tempest-GroupSnapshotsTest-Group-1820927012: created successfully Apr 29 10:30:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f34470ed-67dc-4cce-8549-cf1b4c342bca tempest-GroupSnapshotsTest-1922568388 None] Create group completed successfully. Apr 29 10:30:52 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:30:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Flow 'volume_create_manager' (6032eaf8-210d-4f62-a79a-a7a12696a367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:30:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c42d8b3-b378-4e3a-9807-56486e7fc8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c42d8b3-b378-4e3a-9807-56486e7fc8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1530022435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ea6c48b-5613-4b4c-acaa-1fe718a49015,host='devstack@QuobyteHD#QuobyteHD',id=f6141fb0-cab7-4ab4-a621-6db22e314852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18ab9407f94424ca2e65494665adbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:53Z,use_quota=True,user_id='985cfd986f6640208c67a0c31f1f1541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0187af8f-6b45-4d67-8e10-19dd0224268c),volume_type_id=0187af8f-6b45-4d67-8e10-19dd0224268c)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34291779-33bd-4b5f-b363-b21c9c8bcb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34291779-33bd-4b5f-b363-b21c9c8bcb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f158a7e6-bb88-4d24-980d-42b9ba4dd387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f158a7e6-bb88-4d24-980d-42b9ba4dd387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6141fb0-cab7-4ab4-a621-6db22e314852', 'volume_name': 'volume-f6141fb0-cab7-4ab4-a621-6db22e314852', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6401d1d-9ae0-49d6-bb38-6856356f6221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6401d1d-9ae0-49d6-bb38-6856356f6221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943adff8-6e9c-4c15-b6d7-fc8f83dfc7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:53 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Volume f6141fb0-cab7-4ab4-a621-6db22e314852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6141fb0-cab7-4ab4-a621-6db22e314852', 'volume_size': 1} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ea6c48b-5613-4b4c-acaa-1fe718a49015,created_at=2026-04-29T08:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1530022435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ea6c48b-5613-4b4c-acaa-1fe718a49015,host='devstack@QuobyteHD#QuobyteHD',id=f6141fb0-cab7-4ab4-a621-6db22e314852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18ab9407f94424ca2e65494665adbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:30:53Z,use_quota=True,user_id='985cfd986f6640208c67a0c31f1f1541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0187af8f-6b45-4d67-8e10-19dd0224268c),volume_type_id=0187af8f-6b45-4d67-8e10-19dd0224268c)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Creating volume f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:30:53 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:53 devstack sudo[86299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 1073741824 Apr 29 10:30:53 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:53 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 1073741824" returned: 0 in 0.889s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:53 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 Apr 29 10:30:53 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:54 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852" returned: 0 in 0.770s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:30:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:30:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943adff8-6e9c-4c15-b6d7-fc8f83dfc7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6141fb0-cab7-4ab4-a621-6db22e314852', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd503e78-22b5-4c03-875e-9a5c4dc17383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:30:54 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Volume volume-f6141fb0-cab7-4ab4-a621-6db22e314852 (f6141fb0-cab7-4ab4-a621-6db22e314852): created successfully Apr 29 10:30:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd503e78-22b5-4c03-875e-9a5c4dc17383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:30:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Flow 'volume_create_manager' (6032eaf8-210d-4f62-a79a-a7a12696a367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:30:54 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-17541e76-aeea-481f-88a3-eb35254ff178 tempest-GroupSnapshotsTest-1922568388 None] Created volume successfully. Apr 29 10:30:55 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] GroupSnapshot e2b0d8cb-a314-43f6-a785-98e029fb7030: creating. Apr 29 10:30:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Group snapshot e2b0d8cb-a314-43f6-a785-98e029fb7030: creating. {{(pid=83806) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 10:30:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:30:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:30:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Creating offline snapshot 3709e32d-0198-40fe-8120-6c38d64ed2ce of volume f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:30:55 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0cd2e1-4407-4305-affe-d53daf9166ce]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:30:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:55 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 Apr 29 10:30:55 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:56 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852" returned: 0 in 0.766s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:56 devstack sudo[86316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce 1G Apr 29 10:30:56 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:57 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce 1G" returned: 0 in 1.067s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6141fb0-cab7-4ab4-a621-6db22e314852 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:57 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6141fb0-cab7-4ab4-a621-6db22e314852 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce Apr 29 10:30:57 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:58 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6141fb0-cab7-4ab4-a621-6db22e314852 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce" returned: 0 in 0.768s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:58 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:30:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:58 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce Apr 29 10:30:58 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:58 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce" returned: 0 in 0.713s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:58 devstack sudo[86368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.info Apr 29 10:30:58 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:30:59 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root Apr 29 10:30:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.info" returned: 0 in 0.656s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:30:59 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:30:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:30:59 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.info Apr 29 10:30:59 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:00 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.info" returned: 0 in 0.786s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.860s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:00 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9879fcfb-5c39-4094-bf48-55d58a39fd5d tempest-GroupSnapshotsTest-1922568388 None] group_snapshot e2b0d8cb-a314-43f6-a785-98e029fb7030: created successfully Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=33,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=4 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-3709e32d-0198-40fe-8120-6c38d64ed2ce-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" by "_create_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-3709e32d-0198-40fe-8120-6c38d64ed2ce-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Creating volume 8d34e818-eebe-4a46-a85c-3517d6f7ed8c from snapshot 3709e32d-0198-40fe-8120-6c38d64ed2ce {{(pid=83806) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] snapshot: 3709e32d-0198-40fe-8120-6c38d64ed2ce, volume: 8d34e818-eebe-4a46-a85c-3517d6f7ed8c, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab9cca1-a1c1-4ba1-ad81-8ed2d0d27b8c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:02 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce Apr 29 10:31:02 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:03 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce" returned: 0 in 0.966s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6141fb0-cab7-4ab4-a621-6db22e314852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:31:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:31:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:31:03 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d215d4-1750-49a9-b433-2728809b1f70]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:03 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 Apr 29 10:31:03 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:04 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852" returned: 0 in 0.961s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:04 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:31:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:04 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c Apr 29 10:31:04 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:11 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" returned: 0 in 7.185s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:11 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ab03fe-579d-43b0-a941-d4e3071f388d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:12 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 Apr 29 10:31:12 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:12 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=18,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:31:12 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=2 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:31:13 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852" returned: 0 in 1.512s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:13 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852, size 1024.00 MB, duration 7.19 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:31:13 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Converted 1024.00 MB image at 142.50 MB/s Apr 29 10:31:13 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:31:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:13 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c Apr 29 10:31:13 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:14 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" returned: 0 in 0.724s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" released by "_copy_volume_from_snapshot" :: held 11.505s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-3709e32d-0198-40fe-8120-6c38d64ed2ce-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" released by "_create_volume_from_snapshot" :: held 11.550s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.566s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:14 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6ec2d79f-ca88-4477-b6b0-aeaad301986f tempest-GroupSnapshotsTest-1922568388 None] Create group from source-snapshot-e2b0d8cb-a314-43f6-a785-98e029fb7030 completed successfully. Apr 29 10:31:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" acquired by "delete_volume" :: waited 0.038s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:16 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8611363e-964b-47a1-929e-2076f264df94]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:16 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c Apr 29 10:31:16 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:17 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" returned: 0 in 1.029s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:17 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c Apr 29 10:31:17 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:18 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" returned: 0 in 1.097s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-8d34e818-eebe-4a46-a85c-3517d6f7ed8c" released by "delete_volume" :: held 2.192s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:18 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['490d8fb7-3a8d-4510-8586-2aacafa6dc0c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:31:18 devstack cinder-volume[83806]: WARNING cinder.quota [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-898979904 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-898979904, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:31:18 devstack cinder-volume[83806]: WARNING cinder.quota [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-898979904 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-898979904, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:31:18 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['b53a1763-c816-4a6d-a4db-9ae6312ebb12', '8848ed16-c743-465a-935f-5a9c23a0b15b', '55ff35f4-ba01-4f33-8974-5dcd3531fd6f', 'b55df0d0-673b-4a2e-80e8-6da596fd2fa9'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:31:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:18 devstack sudo[86631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:31:18 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:19 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.888s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:19 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:31:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d2b1a7da-8cd7-4ad2-9e09-0f2f1bf65773 tempest-GroupSnapshotsTest-1922568388 None] Delete group completed successfully. Apr 29 10:31:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] group_snapshot e2b0d8cb-a314-43f6-a785-98e029fb7030: deleting Apr 29 10:31:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] group_snapshot e2b0d8cb-a314-43f6-a785-98e029fb7030: deleting {{(pid=83806) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 10:31:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-f6141fb0-cab7-4ab4-a621-6db22e314852" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-f6141fb0-cab7-4ab4-a621-6db22e314852" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-3709e32d-0198-40fe-8120-6c38d64ed2ce" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-3709e32d-0198-40fe-8120-6c38d64ed2ce" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Deleting offline snapshot 3709e32d-0198-40fe-8120-6c38d64ed2ce of volume f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] snapshot_file for this snap is: volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbd36b7-b730-41a7-ae1c-816d2f089ce0]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:20 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce Apr 29 10:31:20 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Flow 'volume_create_manager' (4cf7da51-bac8-46c6-b953-c8d7afe5dd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576b0215-86ad-4d89-958d-2c541b6e5d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576b0215-86ad-4d89-958d-2c541b6e5d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-919823898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a017f4b8b04821bdd91633201788d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:21Z,use_quota=True,user_id='28da7041b6b14d09bf36792582d6f50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16c28d7-ce8d-4230-bcb5-ee2bf3ef4560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16c28d7-ce8d-4230-bcb5-ee2bf3ef4560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baf2222-5f60-4218-a15f-ff7eef2b95a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baf2222-5f60-4218-a15f-ff7eef2b95a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3', 'volume_name': 'volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc55819-b396-4b62-8f7c-4c5c4a05a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc55819-b396-4b62-8f7c-4c5c4a05a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d05021-0cb0-4ff3-8019-30b63b6f7869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:20 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Volume e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3', 'volume_size': 1} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-919823898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a017f4b8b04821bdd91633201788d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:21Z,use_quota=True,user_id='28da7041b6b14d09bf36792582d6f50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Creating volume e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:31:20 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:31:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:20 devstack sudo[86655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 1073741824 Apr 29 10:31:20 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:21 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce" returned: 0 in 1.090s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6141fb0-cab7-4ab4-a621-6db22e314852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:31:21 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd0f75-3271-42d5-b332-0adbcb9264bc]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:21 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 Apr 29 10:31:21 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:21 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 1073741824" returned: 0 in 0.874s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:21 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 Apr 29 10:31:21 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:22 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852" returned: 0 in 0.852s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:22 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce Apr 29 10:31:22 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:22 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" returned: 0 in 0.663s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d05021-0cb0-4ff3-8019-30b63b6f7869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4374c55-dc14-4d14-9939-b8fd994c6106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:22 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Volume volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 (e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3): created successfully Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4374c55-dc14-4d14-9939-b8fd994c6106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Flow 'volume_create_manager' (4cf7da51-bac8-46c6-b953-c8d7afe5dd42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:31:22 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-dbdb16bb-9ba9-488c-b077-cd536b952f9a req-7f9fc36b-53c2-41ee-9b95-92e78e22dafa tempest-VolumesSnapshotsTestJSON-1690444875 None] Created volume successfully. Apr 29 10:31:22 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce" returned: 0 in 0.684s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:22 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce Apr 29 10:31:22 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Creating offline snapshot b13bf0a9-3d30-4c6b-b029-cfa271525adc of volume e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:31:23 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38fefc7-e4a8-4861-8759-f370ad318d9e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:23 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852.3709e32d-0198-40fe-8120-6c38d64ed2ce" returned: 0 in 0.727s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-3709e32d-0198-40fe-8120-6c38d64ed2ce" released by "_delete_snapshot" :: held 3.515s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-f6141fb0-cab7-4ab4-a621-6db22e314852" released by "delete_snapshot" :: held 3.560s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:23 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 Apr 29 10:31:23 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:23 devstack cinder-volume[83806]: WARNING cinder.quota [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-898979904 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-898979904, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:31:23 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['02360a7b-f706-44e7-bfb0-d1d23c2b7480', 'a7e0276f-4c40-42c8-9780-f4cacda84177', 'b6fd8ab9-9407-4f69-972b-044f9e72c115', 'f5cb155a-ff85-492b-a0aa-2eff683e96e6'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:31:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5f3029f9-1621-4d5b-ab36-359b54733d90 tempest-GroupSnapshotsTest-1922568388 None] group_snapshot e2b0d8cb-a314-43f6-a785-98e029fb7030: deleted successfully Apr 29 10:31:24 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" returned: 0 in 0.761s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:24 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc 1G Apr 29 10:31:24 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-f6141fb0-cab7-4ab4-a621-6db22e314852" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-f6141fb0-cab7-4ab4-a621-6db22e314852" acquired by "delete_volume" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:24 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[747c53f3-adfe-4000-b791-1f232f551cd0]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:24 devstack sudo[86696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 Apr 29 10:31:24 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:24 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc 1G" returned: 0 in 0.808s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:25 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc Apr 29 10:31:25 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:25 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852" returned: 0 in 0.788s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:25 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852 Apr 29 10:31:25 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:25 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc" returned: 0 in 0.727s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:25 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc is being set with open permissions: ugo+rw Apr 29 10:31:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:25 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc Apr 29 10:31:25 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:26 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f6141fb0-cab7-4ab4-a621-6db22e314852" returned: 0 in 0.979s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-f6141fb0-cab7-4ab4-a621-6db22e314852" released by "delete_volume" :: held 1.898s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:26 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['a32a9ad1-4471-43b8-8adf-c6d0ee350217'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:31:26 devstack cinder-volume[83806]: WARNING cinder.db.sqlalchemy.api [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-898979904'] Apr 29 10:31:26 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['9cae9501-57ff-42eb-9639-067ee7640660', 'c1e66797-214d-4d11-97f3-9c56732b0604', '92a238ac-69a9-4698-a607-68f884ff172a', '4ea2c0a3-27a5-419a-a601-4faf60693b70'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:31:27 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc" returned: 0 in 1.300s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:27 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.info Apr 29 10:31:27 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:27 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:31:27 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:28 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.993s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:28 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:31:28 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-8f42a7e8-a160-4024-9c14-22444c8d010d tempest-GroupSnapshotsTest-1922568388 None] Delete group completed successfully. Apr 29 10:31:28 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.info" returned: 0 in 1.460s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:28 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.info is being set with open permissions: ugo+rw Apr 29 10:31:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:28 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.info Apr 29 10:31:28 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-00f53602-7f11-492d-9a6a-50df500fad7d tempest-GroupSnapshotsTest-1922568388 None] Group tempest-GroupSnapshotsTest-Group-411926066: creating Apr 29 10:31:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-00f53602-7f11-492d-9a6a-50df500fad7d tempest-GroupSnapshotsTest-1922568388 None] Group tempest-GroupSnapshotsTest-Group-411926066: created successfully Apr 29 10:31:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-00f53602-7f11-492d-9a6a-50df500fad7d tempest-GroupSnapshotsTest-1922568388 None] Create group completed successfully. Apr 29 10:31:29 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.info" returned: 0 in 0.920s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.174s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-f7fbc7de-4eaa-4f27-86e8-787b9dcf5eb4 req-f1d625cb-39dc-41d7-b940-a6bcdd76dddf tempest-VolumesSnapshotsTestJSON-1690444875 None] Create snapshot completed successfully Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Flow 'volume_create_manager' (7f7129c7-4b60-44a1-a2d8-e49e688bf021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1880b6ef-3ec4-42fd-8540-ac52bf43baab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1880b6ef-3ec4-42fd-8540-ac52bf43baab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1093872376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fc70ca-83e6-4890-9dc4-a3ca2e712b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4efd0c4dac649efbf15597eeda51ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:30Z,use_quota=True,user_id='566c5636d72843e69fded87b24d547ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1510b4-3f97-44f2-8fea-2b5493bb1646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1510b4-3f97-44f2-8fea-2b5493bb1646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e8f6bc-4e67-41d2-b9e6-bf8722247b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e8f6bc-4e67-41d2-b9e6-bf8722247b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fc70ca-83e6-4890-9dc4-a3ca2e712b39', 'volume_name': 'volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9077b0b3-7ff3-4712-9b5f-c5a5aa3222e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9077b0b3-7ff3-4712-9b5f-c5a5aa3222e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9ab7e9-bf85-421a-b912-87a42dff1866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:30 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Volume f1fc70ca-83e6-4890-9dc4-a3ca2e712b39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39', 'volume_size': 1} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1093872376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fc70ca-83e6-4890-9dc4-a3ca2e712b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4efd0c4dac649efbf15597eeda51ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:30Z,use_quota=True,user_id='566c5636d72843e69fded87b24d547ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Creating volume f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:31:30 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Acquiring lock "cinder-b13bf0a9-3d30-4c6b-b029-cfa271525adc-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:30 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 1073741824 Apr 29 10:31:30 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "cinder-b13bf0a9-3d30-4c6b-b029-cfa271525adc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Acquiring lock "cinder-quobyte-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "cinder-quobyte-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Acquiring lock "cinder-quobyte-b13bf0a9-3d30-4c6b-b029-cfa271525adc" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "cinder-quobyte-b13bf0a9-3d30-4c6b-b029-cfa271525adc" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Deleting offline snapshot b13bf0a9-3d30-4c6b-b029-cfa271525adc of volume e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] snapshot_file for this snap is: volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d124d7c-66e5-470a-a663-c06d43de2c72]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:30 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Flow 'volume_create_manager' (c8d6f3bf-5a1f-4cd0-8169-a8bb8c38c355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5f29cf-29f2-4d9e-bbf9-99c5e9a42385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5f29cf-29f2-4d9e-bbf9-99c5e9a42385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-974713649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4cdb1745-acfd-4bc2-a974-e74bffafaa16,host='devstack@QuobyteHD#QuobyteHD',id=3e80fd96-53cc-4741-bd0b-a55184af17c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18ab9407f94424ca2e65494665adbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:31Z,use_quota=True,user_id='985cfd986f6640208c67a0c31f1f1541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f435a044-9c51-4135-8978-cfbc8ddb721d),volume_type_id=f435a044-9c51-4135-8978-cfbc8ddb721d)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:31 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc Apr 29 10:31:31 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a3727c-6972-488f-830f-3e0e4334a4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a3727c-6972-488f-830f-3e0e4334a4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d029a6-c472-4883-92d9-57b799b04161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d029a6-c472-4883-92d9-57b799b04161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e80fd96-53cc-4741-bd0b-a55184af17c3', 'volume_name': 'volume-3e80fd96-53cc-4741-bd0b-a55184af17c3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc844ceb-411c-427c-aeb5-c5db643254a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc844ceb-411c-427c-aeb5-c5db643254a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4621969-2a54-46f9-b7f4-eb8e75f0081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:31 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Volume 3e80fd96-53cc-4741-bd0b-a55184af17c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e80fd96-53cc-4741-bd0b-a55184af17c3', 'volume_size': 1} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:31 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 1073741824" returned: 0 in 0.996s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:31 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc" returned: 0 in 0.795s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e662169-12e3-4aff-b3f7-2949efa36c24]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:31 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 Apr 29 10:31:31 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:31 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 Apr 29 10:31:31 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:32 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39" returned: 0 in 0.702s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4cdb1745-acfd-4bc2-a974-e74bffafaa16,created_at=2026-04-29T08:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-974713649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4cdb1745-acfd-4bc2-a974-e74bffafaa16,host='devstack@QuobyteHD#QuobyteHD',id=3e80fd96-53cc-4741-bd0b-a55184af17c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18ab9407f94424ca2e65494665adbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:31Z,use_quota=True,user_id='985cfd986f6640208c67a0c31f1f1541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f435a044-9c51-4135-8978-cfbc8ddb721d),volume_type_id=f435a044-9c51-4135-8978-cfbc8ddb721d)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Creating volume 3e80fd96-53cc-4741-bd0b-a55184af17c3 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:31:32 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:32 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 1073741824 Apr 29 10:31:32 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9ab7e9-bf85-421a-b912-87a42dff1866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdc5382-6d1e-4679-95d3-06ad21e56e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:32 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Volume volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 (f1fc70ca-83e6-4890-9dc4-a3ca2e712b39): created successfully Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdc5382-6d1e-4679-95d3-06ad21e56e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Flow 'volume_create_manager' (7f7129c7-4b60-44a1-a2d8-e49e688bf021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:31:32 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-98374cb9-165e-4016-95cc-d120eb05ecf8 tempest-VolumesAdminNegativeTest-373061644 None] Created volume successfully. Apr 29 10:31:32 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" returned: 0 in 0.977s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:32 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc Apr 29 10:31:32 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:33 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:31:33 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:33 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 1073741824" returned: 0 in 1.080s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:33 devstack sudo[86856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 Apr 29 10:31:33 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:33 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc" returned: 0 in 1.239s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:34 devstack sudo[86858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc Apr 29 10:31:34 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:34 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.132s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Acquiring lock "cinder-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Lock "cinder-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Acquiring lock "cinder-quobyte-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Lock "cinder-quobyte-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff87254-aca2-4c3d-b457-5ef10bcf3587]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:34 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3" returned: 0 in 0.902s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4621969-2a54-46f9-b7f4-eb8e75f0081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e80fd96-53cc-4741-bd0b-a55184af17c3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a090b0ad-dc0e-4caa-99a4-f775d42a97b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:34 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 Apr 29 10:31:34 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:34 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Volume volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 (3e80fd96-53cc-4741-bd0b-a55184af17c3): created successfully Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a090b0ad-dc0e-4caa-99a4-f775d42a97b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Flow 'volume_create_manager' (c8d6f3bf-5a1f-4cd0-8169-a8bb8c38c355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:31:34 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-56981d7a-9d15-4ace-85cf-88c6179c3138 tempest-GroupSnapshotsTest-1922568388 None] Created volume successfully. Apr 29 10:31:34 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3.b13bf0a9-3d30-4c6b-b029-cfa271525adc" returned: 0 in 0.906s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "cinder-quobyte-b13bf0a9-3d30-4c6b-b029-cfa271525adc" released by "_delete_snapshot" :: held 4.116s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "cinder-quobyte-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" released by "delete_snapshot" :: held 4.165s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:35 devstack cinder-volume[83806]: WARNING cinder.quota [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:31:35 devstack cinder-volume[83806]: DEBUG cinder.quota [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Created reservations ['f96c4cf5-9d88-4303-a2ff-724a872bb98c', '870949e9-b23c-4788-b2b7-e94e6fa37b12', '86eddeb6-9795-4cb4-85b7-6012f9648125', '1f8955c7-10ab-4c39-ae05-8ab7bb98a9ce'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:31:35 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Delete snapshot completed successfully. Apr 29 10:31:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-da41c9e2-849a-41f4-a455-1a75c365e74f req-069ebdaa-4ba6-4279-a406-55a1c2c5ecaf tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "cinder-b13bf0a9-3d30-4c6b-b029-cfa271525adc-delete_snapshot" released by "delete_snapshot" :: held 4.553s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:35 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39" returned: 0 in 1.217s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:35 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39 Apr 29 10:31:35 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Flow 'volume_create_manager' (974619c3-15a3-4bad-a896-c49ec63be672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1899729a-75bc-4e92-bad9-c2dff6909a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Acquiring lock "cinder-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1899729a-75bc-4e92-bad9-c2dff6909a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-131548263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4cdb1745-acfd-4bc2-a974-e74bffafaa16,host='devstack@QuobyteHD#QuobyteHD',id=4cd236a5-3de0-4cd8-9056-3d438fcf120e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18ab9407f94424ca2e65494665adbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:36Z,use_quota=True,user_id='985cfd986f6640208c67a0c31f1f1541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f435a044-9c51-4135-8978-cfbc8ddb721d),volume_type_id=f435a044-9c51-4135-8978-cfbc8ddb721d)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e114456c-a3ea-41f4-9791-26f1759f6d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e114456c-a3ea-41f4-9791-26f1759f6d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172cb300-ceac-4a0b-9cbb-cf758acb1d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172cb300-ceac-4a0b-9cbb-cf758acb1d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd236a5-3de0-4cd8-9056-3d438fcf120e', 'volume_name': 'volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234acd89-5345-4144-b723-0f114677e838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234acd89-5345-4144-b723-0f114677e838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4e938b-8565-41f5-b624-b31c04024ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:36 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Volume 4cd236a5-3de0-4cd8-9056-3d438fcf120e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e', 'volume_size': 1} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4cdb1745-acfd-4bc2-a974-e74bffafaa16,created_at=2026-04-29T08:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-131548263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4cdb1745-acfd-4bc2-a974-e74bffafaa16,host='devstack@QuobyteHD#QuobyteHD',id=4cd236a5-3de0-4cd8-9056-3d438fcf120e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18ab9407f94424ca2e65494665adbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:31:36Z,use_quota=True,user_id='985cfd986f6640208c67a0c31f1f1541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f435a044-9c51-4135-8978-cfbc8ddb721d),volume_type_id=f435a044-9c51-4135-8978-cfbc8ddb721d)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Creating volume 4cd236a5-3de0-4cd8-9056-3d438fcf120e {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:31:36 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "cinder-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3-delete_volume" acquired by "delete_volume" :: waited 0.192s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:36 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e 1073741824 Apr 29 10:31:36 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:36 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Acquiring lock "cinder-quobyte-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39" returned: 0 in 1.213s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Lock "cinder-quobyte-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39" released by "delete_volume" :: held 2.517s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "cinder-quobyte-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" acquired by "delete_volume" :: waited 0.054s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:31:37 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3d5175-034c-4f8c-aecb-080ee5f23188]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:37 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Created reservations ['61d3772b-82e5-46e2-9a4b-df8f1b9ef7bd', '9999bddc-43ee-4875-a7a8-bd6810769131', '4d6b0e64-f9fe-4481-a48b-fce4d7876755', '200a3bf2-050b-4e05-9152-eacae04027cc'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:31:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:37 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 Apr 29 10:31:37 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:37 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:31:37 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:38 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e 1073741824" returned: 0 in 1.888s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:38 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.449s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:38 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:31:38 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Deleted volume successfully. Apr 29 10:31:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2d6d51e9-fa54-4d2e-b82e-9e58f14f0658 tempest-VolumesAdminNegativeTest-373061644 None] Lock "cinder-f1fc70ca-83e6-4890-9dc4-a3ca2e712b39-delete_volume" released by "delete_volume" :: held 4.500s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:38 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e Apr 29 10:31:38 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:39 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" returned: 0 in 1.998s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:39 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3 Apr 29 10:31:39 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:40 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e" returned: 0 in 1.411s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] <== create_volume: return (3405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.416s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4e938b-8565-41f5-b624-b31c04024ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442190c2-507a-4093-b554-cc923e6042ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:31:40 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" returned: 0 in 1.232s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:40 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Volume volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e (4cd236a5-3de0-4cd8-9056-3d438fcf120e): created successfully Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442190c2-507a-4093-b554-cc923e6042ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Flow 'volume_create_manager' (974619c3-15a3-4bad-a896-c49ec63be672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "cinder-quobyte-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3" released by "delete_volume" :: held 3.390s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:40 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d860cb86-40e0-425a-afd4-e9cd1c04b918 tempest-GroupSnapshotsTest-1922568388 None] Created volume successfully. Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG cinder.quota [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Created reservations ['52007139-4fae-4be9-a5e1-d090a398e513', 'a621d153-b787-4f3d-853c-3090a19531c7', '1d417ac0-e89b-463f-9224-0a2a671b7f54', 'e9f5483a-247a-403c-bbd8-fc950847d308'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:40 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:31:40 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:41 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.820s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:41 devstack cinder-volume[83806]: DEBUG cinder.manager [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:31:41 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Deleted volume successfully. Apr 29 10:31:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-70c828db-cf38-4b88-9d34-8b99e1f84868 req-9aa8f1fb-a757-48b3-95fc-71404d4ec10c tempest-VolumesSnapshotsTestJSON-1690444875 None] Lock "cinder-e389c5f8-31a8-4ccf-a46f-d63dc6bdacf3-delete_volume" released by "delete_volume" :: held 4.625s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:31:41 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9cf1cbd1-0761-4449-8b40-ac2b68b0fe59 tempest-GroupSnapshotsTest-1922568388 None] Update group completed successfully. Apr 29 10:31:43 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2f3a1bbb-97ec-4d2f-9781-34704218fabe tempest-GroupSnapshotsTest-1922568388 None] Update group completed successfully. Apr 29 10:31:44 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-bf353ac1-26b0-4058-a1d1-64d89b8c08db tempest-GroupSnapshotsTest-1922568388 None] Update group completed successfully. Apr 29 10:31:45 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-faea78b0-45ac-4470-9e65-4ee92a309788 tempest-GroupSnapshotsTest-1922568388 None] Update group completed successfully. Apr 29 10:31:47 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] GroupSnapshot 48b72930-5427-42b1-9102-7bbeae0f1ddf: creating. Apr 29 10:31:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Group snapshot 48b72930-5427-42b1-9102-7bbeae0f1ddf: creating. {{(pid=83806) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 10:31:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Creating offline snapshot b1a1cd10-5fb6-4439-9de5-1b055a166843 of volume 3e80fd96-53cc-4741-bd0b-a55184af17c3 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:31:47 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[daae590d-825e-44ca-bbf0-0e9b165ebb7b]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:47 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 Apr 29 10:31:47 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:48 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3" returned: 0 in 1.129s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:48 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 1G Apr 29 10:31:48 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:49 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 1G" returned: 0 in 1.041s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:49 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 Apr 29 10:31:49 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:50 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843" returned: 0 in 1.192s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:50 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:31:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:51 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 Apr 29 10:31:51 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:51 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843" returned: 0 in 0.843s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:51 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.info Apr 29 10:31:51 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:52 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.info" returned: 0 in 0.875s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:52 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:31:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:52 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.info Apr 29 10:31:52 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:53 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.info" returned: 0 in 0.901s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.115s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:31:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:31:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:31:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Creating offline snapshot e09e08ab-816c-4001-9027-cb4be1b33abf of volume 4cd236a5-3de0-4cd8-9056-3d438fcf120e {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:31:53 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cab835-4579-4172-9f94-f04242a792b9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:31:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:53 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e Apr 29 10:31:53 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:54 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e" returned: 0 in 0.940s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:54 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf 1G Apr 29 10:31:54 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:55 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf 1G" returned: 0 in 1.024s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:55 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf Apr 29 10:31:55 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:56 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf" returned: 0 in 1.093s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:56 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:31:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:56 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf Apr 29 10:31:56 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:57 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf" returned: 0 in 1.093s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:58 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.info Apr 29 10:31:58 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:31:59 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 29 10:31:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.info" returned: 0 in 1.209s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:31:59 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:31:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:31:59 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.info Apr 29 10:31:59 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:00 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.info" returned: 0 in 0.840s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.362s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:00 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2865178b-3fd3-4f3d-9320-47d7fde1211e tempest-GroupSnapshotsTest-1922568388 None] group_snapshot 48b72930-5427-42b1-9102-7bbeae0f1ddf: created successfully Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Flow 'volume_create_manager' (e525aff4-0e9d-45a1-b051-b14e12c0a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6b9d8d-89ac-404f-94b8-72b5643dae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6b9d8d-89ac-404f-94b8-72b5643dae4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:32:01Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb49209-ea0a-4dc0-b1e7-0ff345607b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273577868c6941fb8f9ddcf6f83a75aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:01Z,use_quota=True,user_id='51cd9fd92ad24bd68ba442d22392cd8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2ad4e0-fd46-418c-9350-b48d6cc8aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2ad4e0-fd46-418c-9350-b48d6cc8aca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785faff8-ca26-4f0b-a88e-6b7a706b57c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.image.glance [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Creating Keystone auth plugin from conf {{(pid=83806) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 10:32:01 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] group_snapshot 48b72930-5427-42b1-9102-7bbeae0f1ddf: deleting Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] group_snapshot 48b72930-5427-42b1-9102-7bbeae0f1ddf: deleting {{(pid=83806) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-3e80fd96-53cc-4741-bd0b-a55184af17c3" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-3e80fd96-53cc-4741-bd0b-a55184af17c3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-b1a1cd10-5fb6-4439-9de5-1b055a166843" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-b1a1cd10-5fb6-4439-9de5-1b055a166843" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Deleting offline snapshot b1a1cd10-5fb6-4439-9de5-1b055a166843 of volume 3e80fd96-53cc-4741-bd0b-a55184af17c3 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] snapshot_file for this snap is: volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d39697-39f2-46c5-8e19-79a04f8ca053]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:01 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 Apr 29 10:32:01 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785faff8-ca26-4f0b-a88e-6b7a706b57c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2eb49209-ea0a-4dc0-b1e7-0ff345607b68', 'volume_name': 'volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87554453-7481-4e1c-8060-ff6ca7fd8d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87554453-7481-4e1c-8060-ff6ca7fd8d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feaea2e6-6e85-4e83-9181-66f5e56d1799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:02 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Volume 2eb49209-ea0a-4dc0-b1e7-0ff345607b68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Trying to clone 2eb49209-ea0a-4dc0-b1e7-0ff345607b68 from image 79b62ee8-86ba-4c65-a753-39d7d038c9fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]). {{(pid=83806) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 10:32:02 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843" returned: 0 in 1.123s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e80fd96-53cc-4741-bd0b-a55184af17c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8f5711-1ca1-48f6-9b44-dfa764a56543]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 10:32:02 devstack cinder-volume[83806]: INFO cinder.image.image_utils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Image download 20.69 MB at 20.69 MB/s Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b723f969-de57-452a-9d90-e4a20a27287d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:02 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 Apr 29 10:32:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:02 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:03 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD Apr 29 10:32:03 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:03 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3" returned: 0 in 1.050s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:03 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD" returned: 0 in 0.878s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:03 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Temporary image 79b62ee8-86ba-4c65-a753-39d7d038c9fd is fetched for user 51cd9fd92ad24bd68ba442d22392cd8b. {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 10:32:03 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 Apr 29 10:32:03 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:03 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d021ba-03bd-4766-84d9-fcb3a929f6f8]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:04 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD Apr 29 10:32:04 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:04 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD" returned: 0 in 0.924s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:32:01Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb49209-ea0a-4dc0-b1e7-0ff345607b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273577868c6941fb8f9ddcf6f83a75aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:01Z,use_quota=True,user_id='51cd9fd92ad24bd68ba442d22392cd8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Creating volume 2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:32:04 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:04 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843" returned: 0 in 1.102s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:04 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 1073741824 Apr 29 10:32:04 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:04 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843 Apr 29 10:32:04 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:05 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3.b1a1cd10-5fb6-4439-9de5-1b055a166843" returned: 0 in 0.823s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-b1a1cd10-5fb6-4439-9de5-1b055a166843" released by "_delete_snapshot" :: held 4.309s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-3e80fd96-53cc-4741-bd0b-a55184af17c3" released by "delete_snapshot" :: held 4.336s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-4cd236a5-3de0-4cd8-9056-3d438fcf120e" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-4cd236a5-3de0-4cd8-9056-3d438fcf120e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-e09e08ab-816c-4001-9027-cb4be1b33abf" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-e09e08ab-816c-4001-9027-cb4be1b33abf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Deleting offline snapshot e09e08ab-816c-4001-9027-cb4be1b33abf of volume 4cd236a5-3de0-4cd8-9056-3d438fcf120e {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] snapshot_file for this snap is: volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b1203a-0c41-4ed0-963e-3c157e9b8f36]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:05 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 1073741824" returned: 0 in 1.111s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:06 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf Apr 29 10:32:06 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:06 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 Apr 29 10:32:06 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:06 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" returned: 0 in 0.748s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Attempting download of 79b62ee8-86ba-4c65-a753-39d7d038c9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}])) to volume 2eb49209-ea0a-4dc0-b1e7-0ff345607b68. {{(pid=83806) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 10:32:06 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf" returned: 0 in 0.971s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a229c0a-70f7-4c05-9bfb-35df5ba38878]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab68344d-4f9a-4536-932f-c470a0d2b755]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_w2c2gv5n {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:07 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e Apr 29 10:32:07 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:07 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_w2c2gv5n Apr 29 10:32:07 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:07 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e" returned: 0 in 0.886s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:07 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf Apr 29 10:32:07 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:07 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_w2c2gv5n" returned: 0 in 1.086s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_w2c2gv5n {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:08 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_w2c2gv5n Apr 29 10:32:08 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:08 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf" returned: 0 in 0.770s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:08 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf Apr 29 10:32:08 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:08 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_w2c2gv5n" returned: 1 in 0.856s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_w2c2gv5n' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:32:08 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[feda6bdd-29dd-49e3-8e72-5d687e8e1c74]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:08 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD Apr 29 10:32:08 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Flow 'volume_create_manager' (51eccc75-46c7-46b1-b020-1438bd5db5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b1d203-fc87-4295-bd5f-72ee60b4a25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b1d203-fc87-4295-bd5f-72ee60b4a25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-945809905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a7400e-f1ac-470a-a995-3e660a3c2812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbfc49a134469099a91b1b63e67335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:09Z,use_quota=True,user_id='c08687cc942a4edc93eda05e8da918e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ff848a-e77d-4dbf-80fd-e5e1f98ec2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ff848a-e77d-4dbf-80fd-e5e1f98ec2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d226489-474d-4542-a360-f5fb7454b906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d226489-474d-4542-a360-f5fb7454b906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a7400e-f1ac-470a-a995-3e660a3c2812', 'volume_name': 'volume-43a7400e-f1ac-470a-a995-3e660a3c2812', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbe0ef9-0911-46bf-88dc-6873defd986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbe0ef9-0911-46bf-88dc-6873defd986d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff97b73-e8f3-4332-8410-73177cd502b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:09 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Volume 43a7400e-f1ac-470a-a995-3e660a3c2812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a7400e-f1ac-470a-a995-3e660a3c2812', 'volume_size': 1} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-945809905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a7400e-f1ac-470a-a995-3e660a3c2812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06dbfc49a134469099a91b1b63e67335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:09Z,use_quota=True,user_id='c08687cc942a4edc93eda05e8da918e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Creating volume 43a7400e-f1ac-470a-a995-3e660a3c2812 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:32:09 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:09 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 1073741824 Apr 29 10:32:09 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:09 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e.e09e08ab-816c-4001-9027-cb4be1b33abf" returned: 0 in 0.858s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-e09e08ab-816c-4001-9027-cb4be1b33abf" released by "_delete_snapshot" :: held 3.632s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-4cd236a5-3de0-4cd8-9056-3d438fcf120e" released by "delete_snapshot" :: held 3.667s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:09 devstack cinder-volume[83806]: WARNING cinder.quota [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1380196111 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1380196111, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:32:09 devstack cinder-volume[83806]: WARNING cinder.quota [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1380196111 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1380196111, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['bf3a2d27-c410-47a0-9065-1c8d79d9d43f', 'dc139b99-b0ed-4fc6-a534-1fbe37a51252', 'b0899b41-bcfc-4ada-a331-5dbf0a9139d9', 'be9c4523-7510-4457-9903-5f44f9a5caf9'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['4bcd30c6-8fb2-449a-a0f0-d72ba4242942', 'ae80acb5-9cd5-45f5-b6bc-faacc716e02c', '3195ed86-8075-409b-9af8-b969cab70945', '84b6d86b-65d0-4f29-a517-b8fabf78fc97'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:09 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] 79b62ee8-86ba-4c65-a753-39d7d038c9fd was qcow2, converting to raw {{(pid=83806) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 10:32:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:09 devstack sudo[87243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 Apr 29 10:32:09 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:09 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6fc796ac-6889-4bec-b211-871464e07a9c tempest-GroupSnapshotsTest-1922568388 None] group_snapshot 48b72930-5427-42b1-9102-7bbeae0f1ddf: deleted successfully Apr 29 10:32:10 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 1073741824" returned: 0 in 1.006s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:10 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 Apr 29 10:32:10 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-3e80fd96-53cc-4741-bd0b-a55184af17c3" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-3e80fd96-53cc-4741-bd0b-a55184af17c3" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:10 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c0eb4c-27fa-4cab-a225-051717e2e21c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:10 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 Apr 29 10:32:10 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:11 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812" returned: 0 in 0.940s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:32:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff97b73-e8f3-4332-8410-73177cd502b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a7400e-f1ac-470a-a995-3e660a3c2812', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de270025-750f-4278-b35e-7c837451017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:11 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Volume volume-43a7400e-f1ac-470a-a995-3e660a3c2812 (43a7400e-f1ac-470a-a995-3e660a3c2812): created successfully Apr 29 10:32:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de270025-750f-4278-b35e-7c837451017b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Flow 'volume_create_manager' (51eccc75-46c7-46b1-b020-1438bd5db5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:11 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e2f2a31f-0114-4030-92e1-342dd42d3e12 tempest-SnapshotMetadataTestJSON-557695940 None] Created volume successfully. Apr 29 10:32:11 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3" returned: 0 in 1.029s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:11 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3 Apr 29 10:32:11 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:12 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" returned: 0 in 2.504s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_cckhj_sfdevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:32:12 devstack cinder-volume[83806]: INFO cinder.image.image_utils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Converted 112.00 MB image at 44.71 MB/s Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:12 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 1G Apr 29 10:32:12 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:12 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3e80fd96-53cc-4741-bd0b-a55184af17c3" returned: 0 in 0.727s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-3e80fd96-53cc-4741-bd0b-a55184af17c3" released by "delete_volume" :: held 1.869s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-4cd236a5-3de0-4cd8-9056-3d438fcf120e" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-4cd236a5-3de0-4cd8-9056-3d438fcf120e" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a20df1b-bbb9-4610-bcc3-c12fabde34f2]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:12 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e Apr 29 10:32:12 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Creating offline snapshot 7258abdb-d6ca-489a-a05a-1f823fa6a869 of volume 43a7400e-f1ac-470a-a995-3e660a3c2812 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f488928-c5ed-4b5f-bd41-15256402c748]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:12 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 Apr 29 10:32:12 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:13 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 1G" returned: 0 in 1.057s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:13 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[878537cb-3c66-4982-81fb-439bdb17b68e]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:13 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e" returned: 0 in 1.001s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:13 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 Apr 29 10:32:13 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:13 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e Apr 29 10:32:13 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:13 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812" returned: 0 in 1.045s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:13 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 1G Apr 29 10:32:13 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:14 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4cd236a5-3de0-4cd8-9056-3d438fcf120e" returned: 0 in 0.695s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-4cd236a5-3de0-4cd8-9056-3d438fcf120e" released by "delete_volume" :: held 1.786s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=98,cinder:SELECT=80,cinder:INSERT=18,cinder:DELETE=4 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:32:14 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=84,cinder:SELECT=104,cinder:INSERT=26,cinder:DELETE=4 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" returned: 0 in 0.849s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['bb53f6cb-02a6-44e6-a036-504aa2a017dc'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:14 devstack cinder-volume[83806]: WARNING cinder.quota [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1380196111 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1380196111, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['0466cfe0-7e44-4f95-b3a6-c79a5a281651', '42b3ae17-8b87-48ab-962a-20eac479e890', 'bab4512c-aea9-4208-b135-85ca972aaec7', 'af9abb65-2095-4975-a2a6-8a3f51a6212c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:14 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 Apr 29 10:32:14 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['085f5c95-c567-4a71-aaf6-2c3d759ad6d4', '2d49dc09-f7ed-46c2-985b-96abe906970b', '7312a254-8a96-49d0-b9b5-714ce6053f30', 'f54c5000-3120-45bc-abf6-cccdfe1d9db1'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:14 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:32:14 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:14 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 1G" returned: 0 in 1.102s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a7400e-f1ac-470a-a995-3e660a3c2812 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:14 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a7400e-f1ac-470a-a995-3e660a3c2812 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 Apr 29 10:32:14 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:15 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" returned: 1 in 0.994s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Downloaded image 79b62ee8-86ba-4c65-a753-39d7d038c9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}])) to volume 2eb49209-ea0a-4dc0-b1e7-0ff345607b68 successfully. {{(pid=83806) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Temporary image 79b62ee8-86ba-4c65-a753-39d7d038c9fd for user 51cd9fd92ad24bd68ba442d22392cd8b is deleted. {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Marking volume 2eb49209-ea0a-4dc0-b1e7-0ff345607b68 as bootable. {{(pid=83806) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Copying metadata from image 79b62ee8-86ba-4c65-a753-39d7d038c9fd to 2eb49209-ea0a-4dc0-b1e7-0ff345607b68. {{(pid=83806) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Creating volume glance metadata for volume 2eb49209-ea0a-4dc0-b1e7-0ff345607b68 backed by image 79b62ee8-86ba-4c65-a753-39d7d038c9fd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83806) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feaea2e6-6e85-4e83-9181-66f5e56d1799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c21b96f-6d57-4a00-a87c-3c69b30158e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:15 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Volume volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 (2eb49209-ea0a-4dc0-b1e7-0ff345607b68): created successfully Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c21b96f-6d57-4a00-a87c-3c69b30158e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Flow 'volume_create_manager' (e525aff4-0e9d-45a1-b051-b14e12c0a014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:15 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-939de3da-7f2f-45ef-bc49-3dfc6c0cf026 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Created volume successfully. Apr 29 10:32:15 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.809s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:32:15 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-cd40c41b-e944-4a49-9379-3221c6518948 tempest-GroupSnapshotsTest-1922568388 None] Delete group completed successfully. Apr 29 10:32:15 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-540860ad-7c6f-4dba-b2b8-6fbc6cb74b7e tempest-GroupSnapshotsTest-1922568388 None] Group tempest-GroupSnapshotsTest-Group-973348003: creating Apr 29 10:32:15 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a7400e-f1ac-470a-a995-3e660a3c2812 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869" returned: 0 in 0.925s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:15 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 is being set with open permissions: ugo+rw Apr 29 10:32:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:15 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-540860ad-7c6f-4dba-b2b8-6fbc6cb74b7e tempest-GroupSnapshotsTest-1922568388 None] Group tempest-GroupSnapshotsTest-Group-973348003: created successfully Apr 29 10:32:15 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 Apr 29 10:32:15 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-540860ad-7c6f-4dba-b2b8-6fbc6cb74b7e tempest-GroupSnapshotsTest-1922568388 None] Create group completed successfully. Apr 29 10:32:15 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:16 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869" returned: 0 in 0.725s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:16 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.info Apr 29 10:32:16 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-907c1635-489f-46cc-8cbf-9405faa1d50d tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:17 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.info" returned: 0 in 0.775s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:17 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.info is being set with open permissions: ugo+rw Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:17 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.info Apr 29 10:32:17 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Flow 'volume_create_manager' (26c1e21b-63bb-4f28-8b8a-b4d03f6a783e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6351c9-a11c-4f8e-9e1b-7146bd31b418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6351c9-a11c-4f8e-9e1b-7146bd31b418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-769718881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=543380f0-96ff-490a-9fda-a67a7ab2bf5a,host='devstack@QuobyteHD#QuobyteHD',id=cebdc327-d3aa-416c-a026-71125ed3e724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18ab9407f94424ca2e65494665adbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:17Z,use_quota=True,user_id='985cfd986f6640208c67a0c31f1f1541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(110c794d-095b-473b-a2ad-83f35e6f41b5),volume_type_id=110c794d-095b-473b-a2ad-83f35e6f41b5)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f82226-d8e8-42ba-84d2-fd60e444c608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f82226-d8e8-42ba-84d2-fd60e444c608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3ea8fc-d800-4538-ae82-5696000f2626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3ea8fc-d800-4538-ae82-5696000f2626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebdc327-d3aa-416c-a026-71125ed3e724', 'volume_name': 'volume-cebdc327-d3aa-416c-a026-71125ed3e724', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4cc9eb-2719-4c9a-8fc8-604588868f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4cc9eb-2719-4c9a-8fc8-604588868f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64691d7-5a15-4af2-9832-40b0a15f352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:17 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Volume cebdc327-d3aa-416c-a026-71125ed3e724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebdc327-d3aa-416c-a026-71125ed3e724', 'volume_size': 1} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:17 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.info" returned: 0 in 0.683s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.358s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-907c1635-489f-46cc-8cbf-9405faa1d50d tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.765s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:18 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f8418a9d-c554-4607-ab7b-0a723f16f433 tempest-SnapshotMetadataTestJSON-557695940 None] Create snapshot completed successfully Apr 29 10:32:18 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f828118a-2223-4df2-8708-46aa16aad4e6]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-907c1635-489f-46cc-8cbf-9405faa1d50d tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:18 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 Apr 29 10:32:18 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:18 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-907c1635-489f-46cc-8cbf-9405faa1d50d tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" returned: 0 in 0.790s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-907c1635-489f-46cc-8cbf-9405faa1d50d tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:18 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 Apr 29 10:32:18 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:19 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-907c1635-489f-46cc-8cbf-9405faa1d50d tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" returned: 1 in 0.762s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-907c1635-489f-46cc-8cbf-9405faa1d50d tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-907c1635-489f-46cc-8cbf-9405faa1d50d tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.614s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.026s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=543380f0-96ff-490a-9fda-a67a7ab2bf5a,created_at=2026-04-29T08:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-769718881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=543380f0-96ff-490a-9fda-a67a7ab2bf5a,host='devstack@QuobyteHD#QuobyteHD',id=cebdc327-d3aa-416c-a026-71125ed3e724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f18ab9407f94424ca2e65494665adbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:17Z,use_quota=True,user_id='985cfd986f6640208c67a0c31f1f1541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(110c794d-095b-473b-a2ad-83f35e6f41b5),volume_type_id=110c794d-095b-473b-a2ad-83f35e6f41b5)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Creating volume cebdc327-d3aa-416c-a026-71125ed3e724 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:32:19 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Acquiring lock "cinder-7258abdb-d6ca-489a-a05a-1f823fa6a869-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:19 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 1073741824 Apr 29 10:32:19 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "cinder-7258abdb-d6ca-489a-a05a-1f823fa6a869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Acquiring lock "cinder-quobyte-43a7400e-f1ac-470a-a995-3e660a3c2812" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-907c1635-489f-46cc-8cbf-9405faa1d50d tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9', 'name': 'volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74049f78-4e91-46fc-99c1-67ff46d84bca', 'enforce_multipath': True} {{(pid=83806) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "cinder-quobyte-43a7400e-f1ac-470a-a995-3e660a3c2812" acquired by "delete_snapshot" :: waited 0.045s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Acquiring lock "cinder-quobyte-7258abdb-d6ca-489a-a05a-1f823fa6a869" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "cinder-quobyte-7258abdb-d6ca-489a-a05a-1f823fa6a869" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Deleting offline snapshot 7258abdb-d6ca-489a-a05a-1f823fa6a869 of volume 43a7400e-f1ac-470a-a995-3e660a3c2812 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] snapshot_file for this snap is: volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1860474-debf-4445-96bb-3657979a4c64]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-08ba03be-59ed-4b79-994e-32ec38c7c957 req-907c1635-489f-46cc-8cbf-9405faa1d50d tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] attachment_update completed successfully. Apr 29 10:32:19 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 Apr 29 10:32:19 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:20 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869" returned: 0 in 0.867s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43a7400e-f1ac-470a-a995-3e660a3c2812(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:32:20 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 1073741824" returned: 0 in 1.118s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb813411-ab4b-41e7-9e63-ce4b96f7042c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:20 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 Apr 29 10:32:20 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:20 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 Apr 29 10:32:20 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:21 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724" returned: 0 in 1.000s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:32:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64691d7-5a15-4af2-9832-40b0a15f352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebdc327-d3aa-416c-a026-71125ed3e724', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93831ba6-eec1-4e9f-bb62-17d03b3524b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:21 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Volume volume-cebdc327-d3aa-416c-a026-71125ed3e724 (cebdc327-d3aa-416c-a026-71125ed3e724): created successfully Apr 29 10:32:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93831ba6-eec1-4e9f-bb62-17d03b3524b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Flow 'volume_create_manager' (26c1e21b-63bb-4f28-8b8a-b4d03f6a783e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:21 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e8593346-272e-44e8-83de-fbd260333a25 tempest-GroupSnapshotsTest-1922568388 None] Created volume successfully. Apr 29 10:32:22 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812" returned: 0 in 1.263s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:22 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 Apr 29 10:32:22 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:22 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869" returned: 0 in 0.764s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:22 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869 Apr 29 10:32:22 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] GroupSnapshot 8eb67478-cde3-488c-868d-72aa1960c8cf: creating. Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Group snapshot 8eb67478-cde3-488c-868d-72aa1960c8cf: creating. {{(pid=83806) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Creating offline snapshot 7b298095-2f68-44c1-99a5-43be1d379a03 of volume cebdc327-d3aa-416c-a026-71125ed3e724 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fdccfc-cb77-4820-acca-c965eeccbc27]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:23 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812.7258abdb-d6ca-489a-a05a-1f823fa6a869" returned: 0 in 0.695s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "cinder-quobyte-7258abdb-d6ca-489a-a05a-1f823fa6a869" released by "_delete_snapshot" :: held 3.770s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "cinder-quobyte-43a7400e-f1ac-470a-a995-3e660a3c2812" released by "delete_snapshot" :: held 3.813s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:23 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 Apr 29 10:32:23 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Created reservations ['074df039-1e88-4b59-b811-6e71e0c0f4f9', '63085c4e-982e-4e85-9076-e1f204f8a86e', 'ffcc9ee9-584f-437e-97df-7a8a8a13bc77', '6024fa21-77a8-4e11-b3ed-4f321bd7902b'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Delete snapshot completed successfully. Apr 29 10:32:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9e572888-c3e3-4f00-9de1-7f54defe4f57 tempest-SnapshotMetadataTestJSON-557695940 None] Lock "cinder-7258abdb-d6ca-489a-a05a-1f823fa6a869-delete_snapshot" released by "delete_snapshot" :: held 3.981s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Acquiring lock "cinder-43a7400e-f1ac-470a-a995-3e660a3c2812-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Lock "cinder-43a7400e-f1ac-470a-a995-3e660a3c2812-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Acquiring lock "cinder-quobyte-43a7400e-f1ac-470a-a995-3e660a3c2812" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Lock "cinder-quobyte-43a7400e-f1ac-470a-a995-3e660a3c2812" acquired by "delete_volume" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:24 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fef973-f80e-4e02-92cc-9a6ce07abf47]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:24 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 Apr 29 10:32:24 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:24 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724" returned: 0 in 0.905s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:24 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 1G Apr 29 10:32:24 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:25 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812" returned: 0 in 0.869s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:25 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812 Apr 29 10:32:25 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:25 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 1G" returned: 0 in 0.998s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebdc327-d3aa-416c-a026-71125ed3e724 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:25 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebdc327-d3aa-416c-a026-71125ed3e724 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 Apr 29 10:32:25 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:25 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43a7400e-f1ac-470a-a995-3e660a3c2812" returned: 0 in 0.715s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Lock "cinder-quobyte-43a7400e-f1ac-470a-a995-3e660a3c2812" released by "delete_volume" :: held 1.669s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Created reservations ['ca05de36-4cc7-41fc-8cd5-c93c87039f44', '499ca79e-d21b-49b3-80da-5bc562f3931f', '39a2a8f5-f0c5-428b-949e-96799ec9d393', '5e314bf9-3a5f-4dd3-8766-232b2f3ef4ac'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:26 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:32:26 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:26 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebdc327-d3aa-416c-a026-71125ed3e724 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03" returned: 0 in 0.753s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:26 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:32:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:26 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 Apr 29 10:32:26 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:26 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.773s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:26 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:32:26 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Deleted volume successfully. Apr 29 10:32:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-59a751c1-da7b-4417-85ef-3873efe8a84b tempest-SnapshotMetadataTestJSON-557695940 None] Lock "cinder-43a7400e-f1ac-470a-a995-3e660a3c2812-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:26 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03" returned: 0 in 0.872s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:27 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.info Apr 29 10:32:27 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:27 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.info" returned: 0 in 0.853s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:27 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:32:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:27 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.info Apr 29 10:32:27 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:28 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.info" returned: 0 in 0.848s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.405s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:28 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-77828b60-559c-4416-97fc-2dc019c2978a tempest-GroupSnapshotsTest-1922568388 None] group_snapshot 8eb67478-cde3-488c-868d-72aa1960c8cf: created successfully Apr 29 10:32:30 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] group_snapshot 8eb67478-cde3-488c-868d-72aa1960c8cf: deleting Apr 29 10:32:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] group_snapshot 8eb67478-cde3-488c-868d-72aa1960c8cf: deleting {{(pid=83806) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 10:32:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-cebdc327-d3aa-416c-a026-71125ed3e724" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-cebdc327-d3aa-416c-a026-71125ed3e724" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-7b298095-2f68-44c1-99a5-43be1d379a03" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-7b298095-2f68-44c1-99a5-43be1d379a03" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Deleting offline snapshot 7b298095-2f68-44c1-99a5-43be1d379a03 of volume cebdc327-d3aa-416c-a026-71125ed3e724 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:32:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] snapshot_file for this snap is: volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:32:30 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf72bcf3-d565-42ff-aca3-7998a1f43a19]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:30 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 Apr 29 10:32:30 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:32 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03" returned: 0 in 1.731s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cebdc327-d3aa-416c-a026-71125ed3e724(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:32:32 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8020c76-3382-458f-a816-7e1d23e7735d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:32 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 Apr 29 10:32:32 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:32:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:33 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:32:33 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:33 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724" returned: 0 in 1.078s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:33 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 Apr 29 10:32:33 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:34 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.938s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:34 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:32:34 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03" returned: 0 in 1.115s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:34 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03 Apr 29 10:32:34 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:35 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724.7b298095-2f68-44c1-99a5-43be1d379a03" returned: 0 in 0.826s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-7b298095-2f68-44c1-99a5-43be1d379a03" released by "_delete_snapshot" :: held 4.931s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-cebdc327-d3aa-416c-a026-71125ed3e724" released by "delete_snapshot" :: held 4.992s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:35 devstack cinder-volume[83806]: WARNING cinder.quota [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-157890037 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-157890037, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:32:35 devstack cinder-volume[83806]: WARNING cinder.quota [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-157890037 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-157890037, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:32:35 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['6eacf456-e4d5-4471-b253-418d708b56f6', '79f55f8c-bed3-4326-9ee6-d7c99dc3589b', '1fa58ed8-a4ca-45ce-8f58-f303f52e6600', 'b64e2e77-198f-4e62-b2cc-09433985d8d1'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:35 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5c886628-7147-43cd-a9ab-328bcd283120 tempest-GroupSnapshotsTest-1922568388 None] group_snapshot 8eb67478-cde3-488c-868d-72aa1960c8cf: deleted successfully Apr 29 10:32:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "cinder-quobyte-cebdc327-d3aa-416c-a026-71125ed3e724" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-cebdc327-d3aa-416c-a026-71125ed3e724" acquired by "delete_volume" :: waited 0.033s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:36 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[be44daa1-6229-40c0-b0f7-41f7fd24cf99]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:36 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 Apr 29 10:32:36 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Flow 'volume_create_manager' (4b1ba382-82d9-4d46-84bb-08c175da76dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6169994c-012b-4a61-b5f0-7446e060b929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6169994c-012b-4a61-b5f0-7446e060b929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1961386250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cc6117-8cb7-42ac-99c7-c666436e4616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42b5d76b6d74df89a4d59f38c413584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:37Z,use_quota=True,user_id='43be002614a146f1a6f389e52990c5a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc25a6f-f3db-444b-a261-bc8910ec7407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc25a6f-f3db-444b-a261-bc8910ec7407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61147e1-3875-4e0b-a07d-d679b5de603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61147e1-3875-4e0b-a07d-d679b5de603a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2cc6117-8cb7-42ac-99c7-c666436e4616', 'volume_name': 'volume-a2cc6117-8cb7-42ac-99c7-c666436e4616', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de7c72f-3fcd-4074-8204-43bef8e57a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de7c72f-3fcd-4074-8204-43bef8e57a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7771ac95-82f7-4f4d-9e27-84e7a68597c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:37 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Volume a2cc6117-8cb7-42ac-99c7-c666436e4616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2cc6117-8cb7-42ac-99c7-c666436e4616', 'volume_size': 1} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1961386250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cc6117-8cb7-42ac-99c7-c666436e4616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42b5d76b6d74df89a4d59f38c413584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:37Z,use_quota=True,user_id='43be002614a146f1a6f389e52990c5a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Creating volume a2cc6117-8cb7-42ac-99c7-c666436e4616 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:32:37 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:37 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616 1073741824 Apr 29 10:32:37 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:37 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724" returned: 0 in 0.793s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:37 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724 Apr 29 10:32:37 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:37 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cebdc327-d3aa-416c-a026-71125ed3e724" returned: 0 in 0.665s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Lock "cinder-quobyte-cebdc327-d3aa-416c-a026-71125ed3e724" released by "delete_volume" :: held 1.549s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:38 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616 1073741824" returned: 0 in 0.819s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['817a8781-15dd-4263-b226-71c9f9c8fc4a'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:38 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616 Apr 29 10:32:38 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:38 devstack cinder-volume[83806]: WARNING cinder.quota [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-157890037 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-157890037, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Created reservations ['054624af-7d66-481d-a6de-adbfbd244d35', 'ac443fd0-5e20-4634-ad89-8a77315b039a', 'e605395a-5a12-4d13-bb11-9a9ccda76433', '3dac6aa5-1b9d-42fe-bf3a-3a1e5568aefc'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:38 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:32:38 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:39 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616" returned: 0 in 1.025s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:32:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7771ac95-82f7-4f4d-9e27-84e7a68597c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2cc6117-8cb7-42ac-99c7-c666436e4616', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087f269a-87a1-48e4-a6b4-867814d39aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:39 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Volume volume-a2cc6117-8cb7-42ac-99c7-c666436e4616 (a2cc6117-8cb7-42ac-99c7-c666436e4616): created successfully Apr 29 10:32:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087f269a-87a1-48e4-a6b4-867814d39aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Flow 'volume_create_manager' (4b1ba382-82d9-4d46-84bb-08c175da76dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:39 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-32747569-1fe0-456c-a7ad-a17cc12e7cda tempest-AbsoluteLimitsTests-1513999938 None] Created volume successfully. Apr 29 10:32:39 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.256s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:39 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:32:39 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-17450f08-2e31-453e-8143-22b8b530a6f1 tempest-GroupSnapshotsTest-1922568388 None] Delete group completed successfully. Apr 29 10:32:40 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Acquiring lock "cinder-a2cc6117-8cb7-42ac-99c7-c666436e4616-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:40 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Lock "cinder-a2cc6117-8cb7-42ac-99c7-c666436e4616-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:40 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Acquiring lock "cinder-quobyte-a2cc6117-8cb7-42ac-99c7-c666436e4616" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:40 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Lock "cinder-quobyte-a2cc6117-8cb7-42ac-99c7-c666436e4616" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:40 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[636980f5-6455-49cb-b2fe-d02ecf86c2c9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:40 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616 Apr 29 10:32:40 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:41 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616" returned: 0 in 1.102s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:41 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616 Apr 29 10:32:42 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:43 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a2cc6117-8cb7-42ac-99c7-c666436e4616" returned: 0 in 1.397s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Lock "cinder-quobyte-a2cc6117-8cb7-42ac-99c7-c666436e4616" released by "delete_volume" :: held 2.584s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:43 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Created reservations ['2c4730ff-bf7c-4740-abcf-bd987c0f7cdd', '80eb9e44-1a0e-4162-bef5-3f3c1e20af05', '4916ad4b-e9b3-4a2a-add2-87b818e494fa', '4c0c404b-d004-46b3-9e6a-60d1a860e994'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:32:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:43 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:32:43 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:45 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.474s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:45 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:32:45 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Deleted volume successfully. Apr 29 10:32:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-748df1ac-cdc3-44cc-816f-c3b9bee277f6 tempest-AbsoluteLimitsTests-1513999938 None] Lock "cinder-a2cc6117-8cb7-42ac-99c7-c666436e4616-delete_volume" released by "delete_volume" :: held 4.448s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:32:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-52549b4d-f4d8-4dc8-b980-3d2ea5c63ba8 tempest-GroupsTest-506757085 None] Group tempest-Group1-1271763560: creating Apr 29 10:32:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-52549b4d-f4d8-4dc8-b980-3d2ea5c63ba8 tempest-GroupsTest-506757085 None] Group tempest-Group1-1271763560: created successfully Apr 29 10:32:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-52549b4d-f4d8-4dc8-b980-3d2ea5c63ba8 tempest-GroupsTest-506757085 None] Create group completed successfully. Apr 29 10:32:53 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-0ab1570a-8e8c-4265-809b-972a9d7ae309 tempest-GroupsTest-506757085 None] Group tempest-Group2-1926091297: creating Apr 29 10:32:53 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-0ab1570a-8e8c-4265-809b-972a9d7ae309 tempest-GroupsTest-506757085 None] Group tempest-Group2-1926091297: created successfully Apr 29 10:32:53 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-0ab1570a-8e8c-4265-809b-972a9d7ae309 tempest-GroupsTest-506757085 None] Create group completed successfully. Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Flow 'volume_create_manager' (e0f68732-eac7-460f-8b91-f851ef30fca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2780fb00-841f-484e-856a-4ba5723aac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2780fb00-841f-484e-856a-4ba5723aac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-870035697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e40925f-94d5-4621-be0d-7372e890310a,host='devstack@QuobyteHD#QuobyteHD',id=4b07518f-29ee-4572-9b28-39bd915304ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c8b056397e4ec5b554993e0ce64ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:55Z,use_quota=True,user_id='c3f7eabbd57f4225a87d9480eb565edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4776784-1e9a-4c4a-935d-05efe9533961),volume_type_id=b4776784-1e9a-4c4a-935d-05efe9533961)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a3b751-82bc-4bcf-9c6e-6f10632783b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a3b751-82bc-4bcf-9c6e-6f10632783b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c629ba-a11a-4640-bf81-47d94fe75423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c629ba-a11a-4640-bf81-47d94fe75423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b07518f-29ee-4572-9b28-39bd915304ff', 'volume_name': 'volume-4b07518f-29ee-4572-9b28-39bd915304ff', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631d8995-e9eb-49f6-ab99-91c3af167f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631d8995-e9eb-49f6-ab99-91c3af167f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7479013a-5f1e-4b1e-abfa-078d6c976ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:55 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Volume 4b07518f-29ee-4572-9b28-39bd915304ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b07518f-29ee-4572-9b28-39bd915304ff', 'volume_size': 1} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e40925f-94d5-4621-be0d-7372e890310a,created_at=2026-04-29T08:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-870035697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e40925f-94d5-4621-be0d-7372e890310a,host='devstack@QuobyteHD#QuobyteHD',id=4b07518f-29ee-4572-9b28-39bd915304ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c8b056397e4ec5b554993e0ce64ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:55Z,use_quota=True,user_id='c3f7eabbd57f4225a87d9480eb565edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4776784-1e9a-4c4a-935d-05efe9533961),volume_type_id=b4776784-1e9a-4c4a-935d-05efe9533961)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Creating volume 4b07518f-29ee-4572-9b28-39bd915304ff {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:32:55 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:32:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:55 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff 1073741824 Apr 29 10:32:55 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Flow 'volume_create_manager' (ac8d6e72-25fe-462a-a211-64bd1fc06d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbc359a-bcef-437f-ad92-e47929a5baa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbc359a-bcef-437f-ad92-e47929a5baa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2140133043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6634051cfcc495499e0a179e4fd555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:56Z,use_quota=True,user_id='04e1de0191be4037854239fa31563b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7ac025-5820-49ae-9108-58432e624cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7ac025-5820-49ae-9108-58432e624cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92faeae7-2cb4-4ec5-ac77-8d220bfe8b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92faeae7-2cb4-4ec5-ac77-8d220bfe8b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b', 'volume_name': 'volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d572aa0-ee41-45dc-a938-731c5735ed39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d572aa0-ee41-45dc-a938-731c5735ed39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9635b608-07ce-4289-b18e-acbc68e0ed39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:56 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Volume ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b', 'volume_size': 1} Apr 29 10:32:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:57 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff 1073741824" returned: 0 in 1.305s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:57 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff Apr 29 10:32:57 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:57 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff" returned: 0 in 0.675s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2140133043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6634051cfcc495499e0a179e4fd555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:32:56Z,use_quota=True,user_id='04e1de0191be4037854239fa31563b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Creating volume ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:32:57 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:57 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b 1073741824 Apr 29 10:32:57 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7479013a-5f1e-4b1e-abfa-078d6c976ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b07518f-29ee-4572-9b28-39bd915304ff', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc401169-4afe-4c06-aab8-c3d5329d0e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:57 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Volume volume-4b07518f-29ee-4572-9b28-39bd915304ff (4b07518f-29ee-4572-9b28-39bd915304ff): created successfully Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc401169-4afe-4c06-aab8-c3d5329d0e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:57 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Flow 'volume_create_manager' (e0f68732-eac7-460f-8b91-f851ef30fca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:58 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-a180e09c-cc1a-4212-978d-d9cf374d7a7c tempest-GroupsTest-506757085 None] Created volume successfully. Apr 29 10:32:58 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b 1073741824" returned: 0 in 0.885s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:58 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b Apr 29 10:32:58 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:59 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" returned: 0 in 0.595s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9635b608-07ce-4289-b18e-acbc68e0ed39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2927c2-3d5a-49c0-9558-22aca52301af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:32:59 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Volume volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b (ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b): created successfully Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2927c2-3d5a-49c0-9558-22aca52301af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Flow 'volume_create_manager' (ac8d6e72-25fe-462a-a211-64bd1fc06d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:32:59 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-47066a69-da84-4f25-90d7-d011db8547e1 tempest-VolumesDeleteCascade-2027561428 None] Created volume successfully. Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Acquiring lock "cinder-quobyte-4b07518f-29ee-4572-9b28-39bd915304ff" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Lock "cinder-quobyte-4b07518f-29ee-4572-9b28-39bd915304ff" acquired by "delete_volume" :: waited 0.027s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7cce9f-5ecc-4d22-bd85-dd21fe21d77c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:59 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff Apr 29 10:32:59 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Creating offline snapshot d38adf4e-366b-4142-94f7-0da43baaa73a of volume ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d45f2f-c9ca-4180-8f52-b6f6cc6db0e8]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:32:59 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-e9d83db1-7fa0-4cfa-a14c-3a8990e70c5c tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Terminate volume connection completed successfully. Apr 29 10:32:59 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-e9d83db1-7fa0-4cfa-a14c-3a8990e70c5c tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Deleting attachment 74049f78-4e91-46fc-99c1-67ff46d84bca. {{(pid=83806) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 10:33:00 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b Apr 29 10:33:00 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:00 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff" returned: 0 in 0.809s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:00 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff Apr 29 10:33:00 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "cinder-2eb49209-ea0a-4dc0-b1e7-0ff345607b68-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "cinder-2eb49209-ea0a-4dc0-b1e7-0ff345607b68-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "cinder-quobyte-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "cinder-quobyte-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:00 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:00 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b852495b-8bcc-41ec-9785-389c07a586a4]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" returned: 0 in 0.828s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:00 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a 1G Apr 29 10:33:00 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:00 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 Apr 29 10:33:00 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:01 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4b07518f-29ee-4572-9b28-39bd915304ff" returned: 0 in 1.220s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Lock "cinder-quobyte-4b07518f-29ee-4572-9b28-39bd915304ff" released by "delete_volume" :: held 2.090s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:01 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Created reservations ['358b1679-6f01-42fa-aa25-fdeeef513803'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:01 devstack cinder-volume[83806]: WARNING cinder.quota [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-568806269 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-568806269, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:33:01 devstack cinder-volume[83806]: WARNING cinder.quota [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-568806269 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-568806269, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:33:01 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" returned: 0 in 1.133s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:01 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Created reservations ['2a51c8df-41bf-4540-bb0c-2a904f73903f', '556588a3-c80e-4453-8edd-24235f5ec115', 'a4831a7c-0ec9-41c8-9cc0-b11c9138f730', '22067306-2061-4a21-8900-d4ba8db5ac24'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:02 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 Apr 29 10:33:02 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:02 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:02 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:02 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a 1G" returned: 0 in 1.576s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:02 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a Apr 29 10:33:02 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:03 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" returned: 1 in 1.605s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:03 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68 Apr 29 10:33:03 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-7ea51dbc-6d55-4f70-a43d-274a6ecde137 tempest-GroupsTest-506757085 None] Created reservations ['5d234c3e-75cc-4f61-850e-fdecc21695d8'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:03 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.579s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:03 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-55405f5c-30af-4963-aeb3-86e33cf994de tempest-GroupsTest-506757085 None] Delete group completed successfully. Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ea51dbc-6d55-4f70-a43d-274a6ecde137 tempest-GroupsTest-506757085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ea51dbc-6d55-4f70-a43d-274a6ecde137 tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7ea51dbc-6d55-4f70-a43d-274a6ecde137 tempest-GroupsTest-506757085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7ea51dbc-6d55-4f70-a43d-274a6ecde137 tempest-GroupsTest-506757085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ea51dbc-6d55-4f70-a43d-274a6ecde137 tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ea51dbc-6d55-4f70-a43d-274a6ecde137 tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:03 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:03 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:03 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a" returned: 0 in 1.530s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:03 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a is being set with open permissions: ugo+rw Apr 29 10:33:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:03 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a Apr 29 10:33:03 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:04 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" returned: 0 in 1.310s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "cinder-quobyte-2eb49209-ea0a-4dc0-b1e7-0ff345607b68" released by "delete_volume" :: held 4.168s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:04 devstack cinder-volume[83806]: DEBUG cinder.quota [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Created reservations ['2f4f082b-285a-4ad0-94fa-a3d9a82729a1', '34dfff75-05b9-4f52-9ecb-822bc0fabbd4', 'f6acdbc7-15d3-40c7-8310-119ba47c82b5', '5433eab9-f102-4c61-bad1-7d7c99c41ffe'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:05 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:05 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:05 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ea51dbc-6d55-4f70-a43d-274a6ecde137 tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.769s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:05 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-7ea51dbc-6d55-4f70-a43d-274a6ecde137 tempest-GroupsTest-506757085 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7ea51dbc-6d55-4f70-a43d-274a6ecde137 tempest-GroupsTest-506757085 None] Delete group completed successfully. Apr 29 10:33:05 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a" returned: 0 in 1.898s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-267c99b6-a736-46fd-8b0d-3b71e053c482 tempest-GroupsTest-506757085 None] Group tempest-GroupsTest-Group-2142441097: creating Apr 29 10:33:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-267c99b6-a736-46fd-8b0d-3b71e053c482 tempest-GroupsTest-506757085 None] Group tempest-GroupsTest-Group-2142441097: created successfully Apr 29 10:33:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-267c99b6-a736-46fd-8b0d-3b71e053c482 tempest-GroupsTest-506757085 None] Create group completed successfully. Apr 29 10:33:05 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.info Apr 29 10:33:05 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:06 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.228s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:06 devstack cinder-volume[83806]: DEBUG cinder.manager [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:06 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Deleted volume successfully. Apr 29 10:33:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-13a78cac-9cff-4871-90e3-6b069c6b2503 req-ed6570e1-8195-4bbf-97cb-b5b344cbc7a9 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "cinder-2eb49209-ea0a-4dc0-b1e7-0ff345607b68-delete_volume" released by "delete_volume" :: held 5.872s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:07 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.info" returned: 0 in 1.329s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:07 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.info is being set with open permissions: ugo+rw Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:07 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.info Apr 29 10:33:07 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Flow 'volume_create_manager' (6eafa4fc-d3aa-43d1-a8a5-4fa9630390d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b091203-0c36-4544-973c-3d43c22c792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b091203-0c36-4544-973c-3d43c22c792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-467090157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eacfd5e-b55a-4c22-afaa-9c6947a9fcd8,host='devstack@QuobyteHD#QuobyteHD',id=3f5b8a67-c518-45ce-bd3e-2b6cb76f142b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c8b056397e4ec5b554993e0ce64ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:08Z,use_quota=True,user_id='c3f7eabbd57f4225a87d9480eb565edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(891d0f69-ab1f-4883-b455-0080ebaa4a95),volume_type_id=891d0f69-ab1f-4883-b455-0080ebaa4a95)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00adc95e-3424-42c1-9e85-b97afba967ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00adc95e-3424-42c1-9e85-b97afba967ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639da579-fcb4-4e2c-a5d0-9eead49698bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639da579-fcb4-4e2c-a5d0-9eead49698bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f5b8a67-c518-45ce-bd3e-2b6cb76f142b', 'volume_name': 'volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39efda23-e9b3-4e77-bd7b-612b0e650c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39efda23-e9b3-4e77-bd7b-612b0e650c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfb9123-d6f6-4fd0-adfd-379ea4141934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:07 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Volume 3f5b8a67-c518-45ce-bd3e-2b6cb76f142b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b', 'volume_size': 1} Apr 29 10:33:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:08 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.info" returned: 0 in 1.074s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.410s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3eacfd5e-b55a-4c22-afaa-9c6947a9fcd8,created_at=2026-04-29T08:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-467090157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eacfd5e-b55a-4c22-afaa-9c6947a9fcd8,host='devstack@QuobyteHD#QuobyteHD',id=3f5b8a67-c518-45ce-bd3e-2b6cb76f142b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c8b056397e4ec5b554993e0ce64ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:08Z,use_quota=True,user_id='c3f7eabbd57f4225a87d9480eb565edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(891d0f69-ab1f-4883-b455-0080ebaa4a95),volume_type_id=891d0f69-ab1f-4883-b455-0080ebaa4a95)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Creating volume 3f5b8a67-c518-45ce-bd3e-2b6cb76f142b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:33:08 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:33:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:08 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b 1073741824 Apr 29 10:33:08 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:08 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-c5223ab9-76af-4c99-b13c-0f3d5f6136a9 tempest-VolumesDeleteCascade-2027561428 None] Create snapshot completed successfully Apr 29 10:33:09 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b 1073741824" returned: 0 in 0.963s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:09 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b Apr 29 10:33:09 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:09 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b" returned: 0 in 0.601s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.274s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] Creating offline snapshot cfc13237-ed4a-44f8-8a84-c7956f5c445b of volume ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfb9123-d6f6-4fd0-adfd-379ea4141934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd227705-f775-4c3d-8409-a0f255e86cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2d4b4c-65fc-4121-a15c-aab63f7d3e0f]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:09 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Volume volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b (3f5b8a67-c518-45ce-bd3e-2b6cb76f142b): created successfully Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd227705-f775-4c3d-8409-a0f255e86cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Flow 'volume_create_manager' (6eafa4fc-d3aa-43d1-a8a5-4fa9630390d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:09 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5a03074c-580e-4f29-bc96-c7b226d49762 tempest-GroupsTest-506757085 None] Created volume successfully. Apr 29 10:33:10 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a Apr 29 10:33:10 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Flow 'volume_create_manager' (659644be-15aa-4a44-af7d-c2a12fd72003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a53e8e2-1454-4203-89e8-05818d85c85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a53e8e2-1454-4203-89e8-05818d85c85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1956784648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eacfd5e-b55a-4c22-afaa-9c6947a9fcd8,host='devstack@QuobyteHD#QuobyteHD',id=8dc835c3-092e-4190-a169-fe75ee3aeb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c8b056397e4ec5b554993e0ce64ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:11Z,use_quota=True,user_id='c3f7eabbd57f4225a87d9480eb565edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(891d0f69-ab1f-4883-b455-0080ebaa4a95),volume_type_id=891d0f69-ab1f-4883-b455-0080ebaa4a95)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226dde51-4e8b-4874-be14-6432a5318ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226dde51-4e8b-4874-be14-6432a5318ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688ceb66-afdb-4e53-a6ae-9b80e40e9c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688ceb66-afdb-4e53-a6ae-9b80e40e9c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc835c3-092e-4190-a169-fe75ee3aeb94', 'volume_name': 'volume-8dc835c3-092e-4190-a169-fe75ee3aeb94', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28575bbd-1b7b-4d40-8f9d-69e912fb71c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28575bbd-1b7b-4d40-8f9d-69e912fb71c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de860bb-a72f-4a8e-8828-cfc99025c736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:10 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Volume 8dc835c3-092e-4190-a169-fe75ee3aeb94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc835c3-092e-4190-a169-fe75ee3aeb94', 'volume_size': 1} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:10 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a" returned: 0 in 0.837s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:33:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:10 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b 1G Apr 29 10:33:10 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:11 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b 1G" returned: 0 in 0.840s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:11 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b Apr 29 10:33:11 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:12 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b" returned: 0 in 0.644s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:12 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b is being set with open permissions: ugo+rw Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:12 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b Apr 29 10:33:12 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:12 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b" returned: 0 in 0.651s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.075s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.216s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3eacfd5e-b55a-4c22-afaa-9c6947a9fcd8,created_at=2026-04-29T08:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1956784648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3eacfd5e-b55a-4c22-afaa-9c6947a9fcd8,host='devstack@QuobyteHD#QuobyteHD',id=8dc835c3-092e-4190-a169-fe75ee3aeb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c8b056397e4ec5b554993e0ce64ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:11Z,use_quota=True,user_id='c3f7eabbd57f4225a87d9480eb565edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(891d0f69-ab1f-4883-b455-0080ebaa4a95),volume_type_id=891d0f69-ab1f-4883-b455-0080ebaa4a95)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Creating volume 8dc835c3-092e-4190-a169-fe75ee3aeb94 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:33:12 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:33:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:13 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94 1073741824 Apr 29 10:33:13 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:13 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-1acf3bc7-4abc-465c-8a4a-3f8d61391554 tempest-VolumesDeleteCascade-2027561428 None] Create snapshot completed successfully Apr 29 10:33:13 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94 1073741824" returned: 0 in 0.822s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:13 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94 Apr 29 10:33:13 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Performing cascade delete. {{(pid=83806) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-cfc13237-ed4a-44f8-8a84-c7956f5c445b-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-cfc13237-ed4a-44f8-8a84-c7956f5c445b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-cfc13237-ed4a-44f8-8a84-c7956f5c445b" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-cfc13237-ed4a-44f8-8a84-c7956f5c445b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Deleting offline snapshot cfc13237-ed4a-44f8-8a84-c7956f5c445b of volume ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] snapshot_file for this snap is: volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa98b5c4-c26c-492b-8f2d-65526baa8015]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:14 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b Apr 29 10:33:14 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:14 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94" returned: 0 in 0.879s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=114,cinder:UPDATE=102,cinder:INSERT=28,cinder:DELETE=7 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de860bb-a72f-4a8e-8828-cfc99025c736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc835c3-092e-4190-a169-fe75ee3aeb94', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20514d7-d0a8-42ca-9896-601db03dbf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=108,cinder:INSERT=33,cinder:UPDATE=116,cinder:DELETE=5 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:33:14 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Volume volume-8dc835c3-092e-4190-a169-fe75ee3aeb94 (8dc835c3-092e-4190-a169-fe75ee3aeb94): created successfully Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20514d7-d0a8-42ca-9896-601db03dbf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Flow 'volume_create_manager' (659644be-15aa-4a44-af7d-c2a12fd72003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:14 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7efb8f12-6c83-4fb4-bd6e-566b7b2d22d3 tempest-GroupsTest-506757085 None] Created volume successfully. Apr 29 10:33:15 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-43b205e1-fb54-4160-8a63-3cdfd607f97a tempest-GroupsTest-506757085 None] Update group completed successfully. Apr 29 10:33:15 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b" returned: 0 in 0.980s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcad11d-a1fd-444e-91ad-d782fcd10927]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Flow 'volume_create_manager' (db014afe-7eb4-4970-8836-17b097fda1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05c4888-19e6-46b3-9d7a-1030adc273b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:15 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a Apr 29 10:33:15 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05c4888-19e6-46b3-9d7a-1030adc273b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1902275104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831fa4ef-8944-4e2c-b4b0-ea6bea56616c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6c8ca1b1b6476f9332fb53e0c2e2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:15Z,use_quota=True,user_id='da691ebdaf734edea91f4bf34bad3221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685e7941-522c-4ab6-b029-e218b40b7cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685e7941-522c-4ab6-b029-e218b40b7cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f16b637-9b7c-4c61-8975-1b0665a3f231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f16b637-9b7c-4c61-8975-1b0665a3f231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '831fa4ef-8944-4e2c-b4b0-ea6bea56616c', 'volume_name': 'volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81a6488-66f0-481e-b8e0-5e27e8b795b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81a6488-66f0-481e-b8e0-5e27e8b795b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b967851-7d60-47f6-8b5c-77504be2ff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:15 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Volume 831fa4ef-8944-4e2c-b4b0-ea6bea56616c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c', 'volume_size': 1} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1902275104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831fa4ef-8944-4e2c-b4b0-ea6bea56616c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6c8ca1b1b6476f9332fb53e0c2e2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:15Z,use_quota=True,user_id='da691ebdaf734edea91f4bf34bad3221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Creating volume 831fa4ef-8944-4e2c-b4b0-ea6bea56616c {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:33:15 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:33:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:15 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c 1073741824 Apr 29 10:33:15 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:16 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a" returned: 0 in 0.832s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:33:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:16 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b Apr 29 10:33:16 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:16 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c 1073741824" returned: 0 in 0.922s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:16 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c Apr 29 10:33:16 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:16 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9c8a407c-23cf-4de6-a9b1-166b7f1cd0c2 tempest-GroupsTest-506757085 None] Update group completed successfully. Apr 29 10:33:16 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-f52a399f-affc-4bc6-9c2c-6c9121df55f7 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Terminate volume connection completed successfully. Apr 29 10:33:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-f52a399f-affc-4bc6-9c2c-6c9121df55f7 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Deleting attachment 147abab2-d05b-4e77-b238-d87dfb323271. {{(pid=83806) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 10:33:16 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b" returned: 0 in 0.786s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:17 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b Apr 29 10:33:17 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:17 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c" returned: 0 in 0.638s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b967851-7d60-47f6-8b5c-77504be2ff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d758099-cac2-4623-9b42-8d9807e30265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:17 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Volume volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c (831fa4ef-8944-4e2c-b4b0-ea6bea56616c): created successfully Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d758099-cac2-4623-9b42-8d9807e30265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Flow 'volume_create_manager' (db014afe-7eb4-4970-8836-17b097fda1ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:17 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-97e0f7b8-9ad8-4aeb-ac8a-d64f05c0e71b tempest-ServersNegativeTestJSON-998189674 None] Created volume successfully. Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "cinder-47786162-84af-4d4c-bf94-742d19976b7c-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "cinder-47786162-84af-4d4c-bf94-742d19976b7c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "cinder-quobyte-47786162-84af-4d4c-bf94-742d19976b7c" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "cinder-quobyte-47786162-84af-4d4c-bf94-742d19976b7c" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce47e17-68e5-4de8-b60c-a33c25de672c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:17 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c Apr 29 10:33:17 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:17 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.cfc13237-ed4a-44f8-8a84-c7956f5c445b" returned: 0 in 0.648s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-cfc13237-ed4a-44f8-8a84-c7956f5c445b" released by "_delete_snapshot" :: held 3.402s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" released by "delete_snapshot" :: held 3.439s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Created reservations ['058bf8bf-f7bd-40d0-a991-4f9b835a2f07', '4769bbd5-0ec3-42f4-805b-0a5c5e186805', 'b3887f34-f40f-40ad-b74b-95228b781a7a', '278fccab-28bb-40ae-8fb7-0d1932b7cbda'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:17 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Delete snapshot completed successfully. Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-cfc13237-ed4a-44f8-8a84-c7956f5c445b-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-d38adf4e-366b-4142-94f7-0da43baaa73a-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-d38adf4e-366b-4142-94f7-0da43baaa73a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-d38adf4e-366b-4142-94f7-0da43baaa73a" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-d38adf4e-366b-4142-94f7-0da43baaa73a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Deleting offline snapshot d38adf4e-366b-4142-94f7-0da43baaa73a of volume ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] snapshot_file for this snap is: volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c11d4f-bcf3-4478-bfe0-bed8ef07a9ad]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:18 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a Apr 29 10:33:18 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Acquiring lock "cinder-quobyte-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Lock "cinder-quobyte-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b" acquired by "delete_volume" :: waited 0.036s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:18 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2277c8e-1d87-4042-9350-59098c8ff1a7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:18 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c" returned: 0 in 0.910s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:18 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c Apr 29 10:33:18 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:18 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b Apr 29 10:33:18 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:18 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a" returned: 0 in 0.942s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:33:18 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3dfdf9-8e6f-4cad-a2a6-551a2c821385]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:19 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b Apr 29 10:33:19 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Flow 'volume_create_manager' (4b73bee2-64c0-4ba3-b7eb-1ca7a7347224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1484ce1f-1cb1-4afb-89a8-40d5e034d872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:19 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-47786162-84af-4d4c-bf94-742d19976b7c" returned: 0 in 0.794s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1484ce1f-1cb1-4afb-89a8-40d5e034d872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-525404993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb3af2e-03ab-4b24-89c1-9cc3a29b6505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6c8ca1b1b6476f9332fb53e0c2e2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:19Z,use_quota=True,user_id='da691ebdaf734edea91f4bf34bad3221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799b16cb-b840-4b32-b204-317491d26f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799b16cb-b840-4b32-b204-317491d26f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1218473b-7089-482f-9783-56d32b3a7a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1218473b-7089-482f-9783-56d32b3a7a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb3af2e-03ab-4b24-89c1-9cc3a29b6505', 'volume_name': 'volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0573e463-0659-44ea-8f9c-5f2b4a85c6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0573e463-0659-44ea-8f9c-5f2b4a85c6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febaa6ff-91d9-4daf-b59b-1c464ef0675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:19 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Volume ccb3af2e-03ab-4b24-89c1-9cc3a29b6505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505', 'volume_size': 1} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-525404993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb3af2e-03ab-4b24-89c1-9cc3a29b6505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6c8ca1b1b6476f9332fb53e0c2e2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:19Z,use_quota=True,user_id='da691ebdaf734edea91f4bf34bad3221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Creating volume ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:33:19 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "cinder-quobyte-47786162-84af-4d4c-bf94-742d19976b7c" released by "delete_volume" :: held 1.830s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:19 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 1073741824 Apr 29 10:33:19 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:19 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b" returned: 0 in 0.970s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.quota [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Created reservations ['721235fa-702a-439f-a5cb-ad4094258257', '81f41b50-ae35-4145-b294-c59cf93d3b55', '75edae0a-98c7-4482-9fd7-573864189b56', '508acbe7-cd81-4425-bf4a-f773e68496cc'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:19 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b Apr 29 10:33:19 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:19 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:19 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:20 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" returned: 0 in 1.051s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:20 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a Apr 29 10:33:20 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:20 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b" returned: 0 in 0.792s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Lock "cinder-quobyte-3f5b8a67-c518-45ce-bd3e-2b6cb76f142b" released by "delete_volume" :: held 1.843s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Acquiring lock "cinder-quobyte-8dc835c3-092e-4190-a169-fe75ee3aeb94" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Lock "cinder-quobyte-8dc835c3-092e-4190-a169-fe75ee3aeb94" acquired by "delete_volume" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04a9d95-275c-43ac-bf0a-65c1a29a5ebe]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:20 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.757s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG cinder.manager [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:20 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Deleted volume successfully. Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-d0e96dae-8646-4efb-898f-8b991cce6410 req-9c38f264-9876-42d7-a1b8-27d4c893ccc1 tempest-ServerBootFromVolumeStableRescueTest-1846480130 None] Lock "cinder-47786162-84af-4d4c-bf94-742d19976b7c-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:20 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 1073741824" returned: 0 in 1.076s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:20 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94 Apr 29 10:33:20 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:20 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 Apr 29 10:33:20 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:20 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a" returned: 0 in 0.942s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:20 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a Apr 29 10:33:20 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:21 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94" returned: 0 in 0.829s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:21 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505" returned: 0 in 0.706s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:21 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94 Apr 29 10:33:21 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febaa6ff-91d9-4daf-b59b-1c464ef0675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985d257a-3c90-48ce-a17e-155f409cc22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:21 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Volume volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 (ccb3af2e-03ab-4b24-89c1-9cc3a29b6505): created successfully Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985d257a-3c90-48ce-a17e-155f409cc22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Flow 'volume_create_manager' (4b73bee2-64c0-4ba3-b7eb-1ca7a7347224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:21 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-055b59d0-e250-41f1-b2bd-3a916fca7917 tempest-ServersNegativeTestJSON-998189674 None] Created volume successfully. Apr 29 10:33:21 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b.d38adf4e-366b-4142-94f7-0da43baaa73a" returned: 0 in 0.716s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-d38adf4e-366b-4142-94f7-0da43baaa73a" released by "_delete_snapshot" :: held 3.813s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" released by "delete_snapshot" :: held 3.844s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:21 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8dc835c3-092e-4190-a169-fe75ee3aeb94" returned: 0 in 0.687s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Lock "cinder-quobyte-8dc835c3-092e-4190-a169-fe75ee3aeb94" released by "delete_volume" :: held 1.572s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Acquiring lock "cinder-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Lock "cinder-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Created reservations ['7467738f-5dfa-4cf1-97c1-d3522f956ff5', '54cd3653-3dd0-482b-bbe6-2e555a5c1e85', '30a330d3-7998-4588-9387-ee190821f67a', '4c6e88cc-3707-4493-97fb-942f91e01651'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Acquiring lock "cinder-quobyte-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Lock "cinder-quobyte-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Created reservations ['17cb7316-6523-4fd5-8792-66f88c495deb'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a59cb5d-5c98-4572-8ac3-231c972e48e8]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:21 devstack cinder-volume[83806]: WARNING cinder.quota [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-810755857 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-810755857, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:33:21 devstack cinder-volume[83806]: WARNING cinder.quota [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-810755857 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-810755857, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:33:21 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Delete snapshot completed successfully. Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-d38adf4e-366b-4142-94f7-0da43baaa73a-delete_snapshot" released by "delete_snapshot" :: held 4.102s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Snapshots deleted, issuing volume delete {{(pid=83806) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Created reservations ['50fff872-f56e-419e-acd3-19f352238efb', '4036bbe9-5f23-4fc7-917f-37cc000fad78', 'e193157a-14f3-4c31-8e0a-3dc93332841a', '010b9ee3-3b05-4e25-b381-0ee641cc5bf3'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:22 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8be849-0c03-4ad4-9c83-581a4c8b8254]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:22 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 Apr 29 10:33:22 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:22 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Created reservations ['a8ae2eeb-f8c8-45e5-9522-1ecaff888464', '570a4214-5e50-4384-abe2-aab0a1d1d853', 'd97f26dd-3122-4057-97f6-a546a5a6bd75', 'bde8e697-ffa4-4b1f-a7ca-f159dce3c8e9'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:22 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b Apr 29 10:33:22 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:22 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:22 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:23 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505" returned: 0 in 1.237s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:23 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505 Apr 29 10:33:23 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:23 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" returned: 0 in 1.233s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:23 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b Apr 29 10:33:23 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:23 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.983s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:23 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9372fd42-737c-4cfa-99b4-413ddcac32b3 tempest-GroupsTest-506757085 None] Delete group completed successfully. Apr 29 10:33:23 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505" returned: 0 in 0.718s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Lock "cinder-quobyte-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505" released by "delete_volume" :: held 2.014s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:23 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Created reservations ['43f748e1-5323-4be7-b392-ea51b0c2a9bf', 'c2ddaf95-9ff5-4982-9643-dcbf8c3f4316', 'a168e00e-a439-49cc-99cc-7fe7056bf317', '84697a1b-1ce7-49f8-b32e-176acf77aa33'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:24 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" returned: 0 in 0.724s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b" released by "delete_volume" :: held 2.043s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:24 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:24 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Acquiring lock "cinder-831fa4ef-8944-4e2c-b4b0-ea6bea56616c-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Created reservations ['74bc9752-fe8d-4d58-a8b6-361837cdf35a', '8b947d08-28e9-4882-9d3c-b2a96b22beb3', '7e066ef0-1bb3-4dac-8899-8379b02061fb', 'c4599b00-2320-4d60-a36c-2ba7c0fef0c2'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Lock "cinder-831fa4ef-8944-4e2c-b4b0-ea6bea56616c-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Acquiring lock "cinder-quobyte-831fa4ef-8944-4e2c-b4b0-ea6bea56616c" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Lock "cinder-quobyte-831fa4ef-8944-4e2c-b4b0-ea6bea56616c" acquired by "delete_volume" :: waited 0.046s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[88baedb6-0ef6-45b5-82b6-353e1a3adbe3]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:24 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:24 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:24 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c Apr 29 10:33:24 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:24 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.811s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:24 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Deleted volume successfully. Apr 29 10:33:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52c57090-ef1e-447d-92d2-d3acbdf3568e tempest-ServersNegativeTestJSON-998189674 None] Lock "cinder-ccb3af2e-03ab-4b24-89c1-9cc3a29b6505-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:25 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.767s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:25 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Deleted volume successfully. Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-95fb3039-bc0d-4c17-a340-3fdc3b9d0406 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-ddd2ee19-559b-4170-a08e-1ae4a4ca4a9b-delete_volume" released by "delete_volume" :: held 11.192s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:25 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c" returned: 0 in 0.992s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:25 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c Apr 29 10:33:25 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Flow 'volume_create_manager' (f46812fd-7e71-4bc4-8193-e9f3e8a7ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d18dc5-a87b-4797-bb44-b08d13d8579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d18dc5-a87b-4797-bb44-b08d13d8579b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2086917096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97aac798-5dbe-42f5-b1d7-b08596f0023d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6634051cfcc495499e0a179e4fd555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:26Z,use_quota=True,user_id='04e1de0191be4037854239fa31563b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f47f0a-2c0f-4108-ab1d-c04579356cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f47f0a-2c0f-4108-ab1d-c04579356cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e6aac3-912b-47f3-8d4e-e40f651927f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e6aac3-912b-47f3-8d4e-e40f651927f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97aac798-5dbe-42f5-b1d7-b08596f0023d', 'volume_name': 'volume-97aac798-5dbe-42f5-b1d7-b08596f0023d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d722e49d-2153-421d-a865-505614d134b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d722e49d-2153-421d-a865-505614d134b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff352b06-b910-4661-83ab-be4755937ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:25 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Volume 97aac798-5dbe-42f5-b1d7-b08596f0023d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97aac798-5dbe-42f5-b1d7-b08596f0023d', 'volume_size': 1} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2086917096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97aac798-5dbe-42f5-b1d7-b08596f0023d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6634051cfcc495499e0a179e4fd555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:26Z,use_quota=True,user_id='04e1de0191be4037854239fa31563b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Creating volume 97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:33:25 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:33:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:26 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d 1073741824 Apr 29 10:33:26 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:26 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-831fa4ef-8944-4e2c-b4b0-ea6bea56616c" returned: 0 in 0.763s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Lock "cinder-quobyte-831fa4ef-8944-4e2c-b4b0-ea6bea56616c" released by "delete_volume" :: held 1.841s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:26 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Created reservations ['e8599d95-1b9a-4610-be29-07845a34624a', '58e3f674-42b2-43f6-bf3c-5e204ba36bbf', '9ca3d933-cb4a-47a6-9cc0-80c72dca5290', 'dce5b788-2290-47da-b9e6-3067aa5d9b5f'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:26 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:26 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:27 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d 1073741824" returned: 0 in 1.268s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:27 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d Apr 29 10:33:27 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:27 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.091s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:27 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Deleted volume successfully. Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-25353d11-6306-4a55-8ef4-d00b643a2eba tempest-ServersNegativeTestJSON-998189674 None] Lock "cinder-831fa4ef-8944-4e2c-b4b0-ea6bea56616c-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:27 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d" returned: 0 in 0.644s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff352b06-b910-4661-83ab-be4755937ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97aac798-5dbe-42f5-b1d7-b08596f0023d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eeb1d2-6311-4d08-911d-fa2853487150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:27 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Volume volume-97aac798-5dbe-42f5-b1d7-b08596f0023d (97aac798-5dbe-42f5-b1d7-b08596f0023d): created successfully Apr 29 10:33:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eeb1d2-6311-4d08-911d-fa2853487150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Flow 'volume_create_manager' (f46812fd-7e71-4bc4-8193-e9f3e8a7ac52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:28 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e6d416c0-f73b-4a3a-8118-bebd62458012 tempest-VolumesDeleteCascade-2027561428 None] Created volume successfully. Apr 29 10:33:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Creating offline snapshot 4cc50789-595f-4284-8160-3e47f2993ee2 of volume 97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:33:29 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e7d09f-6b9e-4bc8-b78e-a596bab9b20c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:29 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d Apr 29 10:33:29 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f170c3bf-fda6-4857-aadb-1ec5574e099b tempest-GroupsV314Test-2066637164 None] Group tempest-GroupsV314Test-Group-1184636907: creating Apr 29 10:33:30 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f170c3bf-fda6-4857-aadb-1ec5574e099b tempest-GroupsV314Test-2066637164 None] Group tempest-GroupsV314Test-Group-1184636907: created successfully Apr 29 10:33:30 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f170c3bf-fda6-4857-aadb-1ec5574e099b tempest-GroupsV314Test-2066637164 None] Create group completed successfully. Apr 29 10:33:30 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d" returned: 0 in 0.967s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:30 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 1G Apr 29 10:33:30 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:31 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 1G" returned: 0 in 0.963s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97aac798-5dbe-42f5-b1d7-b08596f0023d -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:31 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97aac798-5dbe-42f5-b1d7-b08596f0023d -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 Apr 29 10:33:31 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Flow 'volume_create_manager' (71f7cc34-62a9-42e4-b44b-810ea9b12c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa5f2f1-caf2-4f79-81b2-31e60f426a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa5f2f1-caf2-4f79-81b2-31e60f426a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381635541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20af2020-ca21-4013-8958-2cdd9f99eac5,host='devstack@QuobyteHD#QuobyteHD',id=3786dfab-c627-47ed-a6f4-bb18102585b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b3db8c81d84fb3893122537ebc6a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:32Z,use_quota=True,user_id='fae410ad7491472fa6b4f34a94381542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9569bff0-fdf7-4942-8290-645c4e390b4a),volume_type_id=9569bff0-fdf7-4942-8290-645c4e390b4a)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad4a706-c7dd-4d28-9684-53ca0090fd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad4a706-c7dd-4d28-9684-53ca0090fd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff113b60-6e78-4227-8671-d7fca3368a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff113b60-6e78-4227-8671-d7fca3368a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3786dfab-c627-47ed-a6f4-bb18102585b3', 'volume_name': 'volume-3786dfab-c627-47ed-a6f4-bb18102585b3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c7730b-ee34-4c74-a470-003aacb9e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c7730b-ee34-4c74-a470-003aacb9e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4aa0d3f-a0bf-4a75-824e-4813064c8e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:31 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Volume 3786dfab-c627-47ed-a6f4-bb18102585b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3786dfab-c627-47ed-a6f4-bb18102585b3', 'volume_size': 1} Apr 29 10:33:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:32 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97aac798-5dbe-42f5-b1d7-b08596f0023d -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2" returned: 0 in 0.841s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:32 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 is being set with open permissions: ugo+rw Apr 29 10:33:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:32 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 Apr 29 10:33:32 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:32 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2" returned: 0 in 0.650s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:32 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.info Apr 29 10:33:32 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:33 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:33 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:33 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.info" returned: 0 in 0.714s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:33 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.info is being set with open permissions: ugo+rw Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:33 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.info Apr 29 10:33:33 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:33 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.720s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:34 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.info" returned: 0 in 0.713s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.956s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.495s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=20af2020-ca21-4013-8958-2cdd9f99eac5,created_at=2026-04-29T08:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381635541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=20af2020-ca21-4013-8958-2cdd9f99eac5,host='devstack@QuobyteHD#QuobyteHD',id=3786dfab-c627-47ed-a6f4-bb18102585b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b3db8c81d84fb3893122537ebc6a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:32Z,use_quota=True,user_id='fae410ad7491472fa6b4f34a94381542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9569bff0-fdf7-4942-8290-645c4e390b4a),volume_type_id=9569bff0-fdf7-4942-8290-645c4e390b4a)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Creating volume 3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:33:34 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:33:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:34 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 1073741824 Apr 29 10:33:34 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:34 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-72d30ae6-051e-4f62-b22e-db3b0b929346 tempest-VolumesDeleteCascade-2027561428 None] Create snapshot completed successfully Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Flow 'volume_create_manager' (9d2320f5-f850-4a49-8e2a-de0b17434d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde798d3-cbee-4785-afe4-d9379fa4f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde798d3-cbee-4785-afe4-d9379fa4f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1250732786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87182bd-acdf-4e40-ad12-088aded8bd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6634051cfcc495499e0a179e4fd555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4cc50789-595f-4284-8160-3e47f2993ee2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:35Z,use_quota=True,user_id='04e1de0191be4037854239fa31563b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f240c7d-12df-4443-aae9-b47be00e7eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f240c7d-12df-4443-aae9-b47be00e7eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79348b81-d78a-42dd-b0ce-7b56d6c3a08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79348b81-d78a-42dd-b0ce-7b56d6c3a08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a87182bd-acdf-4e40-ad12-088aded8bd91', 'volume_name': 'volume-a87182bd-acdf-4e40-ad12-088aded8bd91', 'volume_size': 1, 'snapshot_id': '4cc50789-595f-4284-8160-3e47f2993ee2'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ea7a76-a7eb-4d97-8620-c3a4c81233ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ea7a76-a7eb-4d97-8620-c3a4c81233ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7be672-c8f7-4d01-9914-058990af1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:35 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Volume a87182bd-acdf-4e40-ad12-088aded8bd91: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a87182bd-acdf-4e40-ad12-088aded8bd91', 'volume_size': 1, 'snapshot_id': '4cc50789-595f-4284-8160-3e47f2993ee2'} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:35 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 1073741824" returned: 0 in 1.045s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:35 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 Apr 29 10:33:35 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Flow 'volume_create_manager' (7f42d647-fdc8-4a98-bb2a-657e9472a925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad690b6-65ee-4df0-a9a6-5eef081e0e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad690b6-65ee-4df0-a9a6-5eef081e0e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1996093480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3014089b-7baf-416d-a8e9-3cab320e00e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='86c7a625136b4e0aab06b9f05c97ca1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:36Z,use_quota=True,user_id='01a8f73df9684cf1a65d878238b267b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a8e058-efe5-401b-be1c-7b5733479619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a8e058-efe5-401b-be1c-7b5733479619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf577a94-eb2d-4704-8e80-07f890415588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf577a94-eb2d-4704-8e80-07f890415588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3014089b-7baf-416d-a8e9-3cab320e00e1', 'volume_name': 'volume-3014089b-7baf-416d-a8e9-3cab320e00e1', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9387c087-d84b-494b-ae2e-f1ac691f61e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9387c087-d84b-494b-ae2e-f1ac691f61e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cca530e-648b-4da3-913a-778fcc83cc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:36 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Volume 3014089b-7baf-416d-a8e9-3cab320e00e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3014089b-7baf-416d-a8e9-3cab320e00e1', 'volume_size': 1} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:36 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3" returned: 0 in 0.756s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.879s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-4cc50789-595f-4284-8160-3e47f2993ee2-a87182bd-acdf-4e40-ad12-088aded8bd91" by "_create_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-4cc50789-595f-4284-8160-3e47f2993ee2-a87182bd-acdf-4e40-ad12-088aded8bd91" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Creating volume a87182bd-acdf-4e40-ad12-088aded8bd91 from snapshot 4cc50789-595f-4284-8160-3e47f2993ee2 {{(pid=83806) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-a87182bd-acdf-4e40-ad12-088aded8bd91" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4aa0d3f-a0bf-4a75-824e-4813064c8e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3786dfab-c627-47ed-a6f4-bb18102585b3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69431596-b4a3-4235-ab7e-7e3371ad787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-a87182bd-acdf-4e40-ad12-088aded8bd91" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] snapshot: 4cc50789-595f-4284-8160-3e47f2993ee2, volume: a87182bd-acdf-4e40-ad12-088aded8bd91, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:33:36 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Volume volume-3786dfab-c627-47ed-a6f4-bb18102585b3 (3786dfab-c627-47ed-a6f4-bb18102585b3): created successfully Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69431596-b4a3-4235-ab7e-7e3371ad787b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Flow 'volume_create_manager' (71f7cc34-62a9-42e4-b44b-810ea9b12c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43f55ac-0b0e-4195-a66e-1d640a8f82d8]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:36 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7332fe5c-5d62-406a-aad3-cef952ac292b tempest-GroupsV314Test-2066637164 None] Created volume successfully. Apr 29 10:33:36 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 Apr 29 10:33:36 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:37 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2" returned: 0 in 0.753s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97aac798-5dbe-42f5-b1d7-b08596f0023d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:33:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:33:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:33:37 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a7411-839b-4340-b1c6-d8f311f4e12c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:37 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d Apr 29 10:33:37 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:37 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d" returned: 0 in 0.880s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:37 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:33:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:37 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 Apr 29 10:33:37 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:43 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91" returned: 0 in 5.541s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:43 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9013f8-4300-48c7-a765-1d2917a45b73]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:43 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d Apr 29 10:33:43 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:44 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d" returned: 0 in 0.886s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:44 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:33:44 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Converted 1024.00 MB image at 184.75 MB/s Apr 29 10:33:44 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 is being set with open permissions: ugo+rw Apr 29 10:33:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:44 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 Apr 29 10:33:44 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:45 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91" returned: 0 in 0.669s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-a87182bd-acdf-4e40-ad12-088aded8bd91" released by "_copy_volume_from_snapshot" :: held 8.865s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-4cc50789-595f-4284-8160-3e47f2993ee2-a87182bd-acdf-4e40-ad12-088aded8bd91" released by "_create_volume_from_snapshot" :: held 8.923s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.946s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.967s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1996093480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3014089b-7baf-416d-a8e9-3cab320e00e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='86c7a625136b4e0aab06b9f05c97ca1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:36Z,use_quota=True,user_id='01a8f73df9684cf1a65d878238b267b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Creating volume 3014089b-7baf-416d-a8e9-3cab320e00e1 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:33:45 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:45 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1 1073741824 Apr 29 10:33:45 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7be672-c8f7-4d01-9914-058990af1ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87182bd-acdf-4e40-ad12-088aded8bd91', 'volume_size': 1, 'snapshot_id': '4cc50789-595f-4284-8160-3e47f2993ee2'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e61f79a-97dd-4b4e-b46f-218d3507191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:45 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Volume volume-a87182bd-acdf-4e40-ad12-088aded8bd91 (a87182bd-acdf-4e40-ad12-088aded8bd91): created successfully Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e61f79a-97dd-4b4e-b46f-218d3507191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Flow 'volume_create_manager' (9d2320f5-f850-4a49-8e2a-de0b17434d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:45 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d696e29a-b872-4494-aa13-95bb17a49e61 tempest-VolumesDeleteCascade-2027561428 None] Created volume successfully. Apr 29 10:33:45 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1 1073741824" returned: 0 in 0.833s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:45 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1 Apr 29 10:33:45 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-97aac798-5dbe-42f5-b1d7-b08596f0023d-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-97aac798-5dbe-42f5-b1d7-b08596f0023d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Performing cascade delete. {{(pid=83806) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-4cc50789-595f-4284-8160-3e47f2993ee2-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-4cc50789-595f-4284-8160-3e47f2993ee2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-97aac798-5dbe-42f5-b1d7-b08596f0023d" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-97aac798-5dbe-42f5-b1d7-b08596f0023d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-4cc50789-595f-4284-8160-3e47f2993ee2" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-4cc50789-595f-4284-8160-3e47f2993ee2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Deleting offline snapshot 4cc50789-595f-4284-8160-3e47f2993ee2 of volume 97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] snapshot_file for this snap is: volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36c5ee6-4604-47fa-860b-d23eb56d735e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:46 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 Apr 29 10:33:46 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:46 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1" returned: 0 in 0.657s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.184s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:46 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Cloning volume 3786dfab-c627-47ed-a6f4-bb18102585b3 to volume 4ca40613-5f81-453e-a226-9ea88497076d Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cca530e-648b-4da3-913a-778fcc83cc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3014089b-7baf-416d-a8e9-3cab320e00e1', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ad06c8-bae6-4635-98dd-f068bbc26cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Creating offline snapshot 8337fa65-c16c-4ae9-be60-ff1a2579dadf of volume 3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:33:46 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Volume volume-3014089b-7baf-416d-a8e9-3cab320e00e1 (3014089b-7baf-416d-a8e9-3cab320e00e1): created successfully Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ad06c8-bae6-4635-98dd-f068bbc26cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Flow 'volume_create_manager' (7f42d647-fdc8-4a98-bb2a-657e9472a925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[82980518-a2b0-418e-b4fd-9ba29b002376]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:46 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-6a91fc58-7e67-4507-8654-ec90bececb03 req-f2b2f65e-b6eb-4c4b-b6f5-8ad3de55723b tempest-VolumesGetTestJSON-1531004758 None] Created volume successfully. Apr 29 10:33:46 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 Apr 29 10:33:46 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:47 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2" returned: 0 in 0.835s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97aac798-5dbe-42f5-b1d7-b08596f0023d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:33:47 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5a6045-72fe-431c-90ac-a675d8d5c381]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:47 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d Apr 29 10:33:47 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:47 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3" returned: 0 in 0.803s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:47 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf 1G Apr 29 10:33:47 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Acquiring lock "cinder-3014089b-7baf-416d-a8e9-3cab320e00e1-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Lock "cinder-3014089b-7baf-416d-a8e9-3cab320e00e1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Acquiring lock "cinder-quobyte-3014089b-7baf-416d-a8e9-3cab320e00e1" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Lock "cinder-quobyte-3014089b-7baf-416d-a8e9-3cab320e00e1" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd5353e-dac6-4b12-9562-147e6cd58495]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:48 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d" returned: 0 in 0.841s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:48 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1 Apr 29 10:33:48 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:48 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 Apr 29 10:33:48 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:48 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf 1G" returned: 0 in 0.830s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3786dfab-c627-47ed-a6f4-bb18102585b3 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:48 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3786dfab-c627-47ed-a6f4-bb18102585b3 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf Apr 29 10:33:48 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9c35d86b-18c4-4114-bbe5-fe69982e9374 tempest-BackendsCapabilitiesAdminTestsJSON-2006088465 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6770401000977, 'free_capacity_gb': 1775.6770401000977, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83806) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 10:33:48 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1" returned: 0 in 0.763s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:48 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1 Apr 29 10:33:48 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:48 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2" returned: 0 in 0.740s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:48 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2 Apr 29 10:33:48 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:49 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3786dfab-c627-47ed-a6f4-bb18102585b3 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf" returned: 0 in 0.690s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:49 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-67eea56f-4a28-4762-ab29-db26936fd891 tempest-BackendsCapabilitiesAdminTestsJSON-2006088465 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6770401000977, 'free_capacity_gb': 1775.6770401000977, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83806) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 10:33:49 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf Apr 29 10:33:49 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:49 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3014089b-7baf-416d-a8e9-3cab320e00e1" returned: 0 in 0.645s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Lock "cinder-quobyte-3014089b-7baf-416d-a8e9-3cab320e00e1" released by "delete_volume" :: held 1.461s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:49 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d.4cc50789-595f-4284-8160-3e47f2993ee2" returned: 0 in 0.643s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.quota [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Created reservations ['e7f91900-4b5b-4a4c-90da-3978d476d337', 'cc3d6552-5773-4524-bf7d-81969dd95b52', 'f7390f22-a67f-4e4d-9d78-e0c5ab0b2a1e', '4c7d2c8f-0ffa-478e-aa2e-cada93b31b54'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-4cc50789-595f-4284-8160-3e47f2993ee2" released by "_delete_snapshot" :: held 3.182s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-97aac798-5dbe-42f5-b1d7-b08596f0023d" released by "delete_snapshot" :: held 3.209s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:49 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf" returned: 0 in 0.610s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Created reservations ['64c2cab3-475a-45fe-a0c7-5d4a3b5ece0f', 'eb423d33-77e5-49ff-89e5-643c65400fc0', '41f91636-f5e5-4aaa-9475-651310c1e3e8', '88f96052-f519-40e0-8dad-45d7a2d5772b'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:49 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:49 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:49 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.info Apr 29 10:33:49 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:49 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Delete snapshot completed successfully. Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-4cc50789-595f-4284-8160-3e47f2993ee2-delete_snapshot" released by "delete_snapshot" :: held 3.443s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Snapshots deleted, issuing volume delete {{(pid=83806) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-97aac798-5dbe-42f5-b1d7-b08596f0023d" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-97aac798-5dbe-42f5-b1d7-b08596f0023d" acquired by "delete_volume" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50e02a9-93c8-45e0-9640-922ab37d8dba]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:50 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d Apr 29 10:33:50 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:50 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.721s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:50 devstack cinder-volume[83806]: DEBUG cinder.manager [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:50 devstack cinder-volume[83806]: INFO cinder.volume.manager [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Deleted volume successfully. Apr 29 10:33:50 devstack cinder-volume[83806]: DEBUG cinder.coordination [req-62968250-5cf6-4817-8584-d8bc43ca9543 req-d274a9ed-bfca-477a-a7a2-b6d2d0ff302b tempest-VolumesGetTestJSON-1531004758 None] Lock "cinder-3014089b-7baf-416d-a8e9-3cab320e00e1-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:50 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.info" returned: 0 in 0.903s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:50 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:33:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:50 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.info Apr 29 10:33:50 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:50 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d" returned: 0 in 0.918s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:50 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d Apr 29 10:33:50 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:51 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.info" returned: 0 in 0.779s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Acquiring lock "cinder-quobyte-4ca40613-5f81-453e-a226-9ea88497076d" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Lock "cinder-quobyte-4ca40613-5f81-453e-a226-9ea88497076d" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] snapshot: 8337fa65-c16c-4ae9-be60-ff1a2579dadf, volume: 4ca40613-5f81-453e-a226-9ea88497076d, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[237a31f3-17ad-4842-b83d-4100dfd3ad84]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:51 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-97aac798-5dbe-42f5-b1d7-b08596f0023d" returned: 0 in 0.901s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:51 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf Apr 29 10:33:51 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-97aac798-5dbe-42f5-b1d7-b08596f0023d" released by "delete_volume" :: held 1.936s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Created reservations ['26b4ac7d-a566-4096-8a8c-7493c6b424ce', '201105b2-0918-42cd-b9c5-536ea3c50aad', 'b3519666-3a17-4a53-8f1a-d4b09c396549', '9e6e374e-2a42-4ab9-918d-02283267a022'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:51 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:51 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:52 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf" returned: 0 in 1.082s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3786dfab-c627-47ed-a6f4-bb18102585b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:33:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:33:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:33:52 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.740s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:52 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:52 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Deleted volume successfully. Apr 29 10:33:52 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ba4169-c4b5-429e-89ce-1505a186da8e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5a8071f0-2c33-4406-9e6f-176416729b76 tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-97aac798-5dbe-42f5-b1d7-b08596f0023d-delete_volume" released by "delete_volume" :: held 6.438s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:52 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 Apr 29 10:33:52 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-a87182bd-acdf-4e40-ad12-088aded8bd91-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-a87182bd-acdf-4e40-ad12-088aded8bd91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "cinder-quobyte-a87182bd-acdf-4e40-ad12-088aded8bd91" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:33:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-a87182bd-acdf-4e40-ad12-088aded8bd91" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:33:53 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d65eec5-fb21-408f-bfee-1d67e5c9012a]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:53 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 Apr 29 10:33:53 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:53 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3" returned: 0 in 0.897s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:53 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:33:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:53 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d Apr 29 10:33:53 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:53 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91" returned: 0 in 0.847s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:54 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91 Apr 29 10:33:54 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:54 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a87182bd-acdf-4e40-ad12-088aded8bd91" returned: 0 in 0.929s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-quobyte-a87182bd-acdf-4e40-ad12-088aded8bd91" released by "delete_volume" :: held 1.854s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:55 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Created reservations ['5b08b557-2384-4c50-a35d-6f5633c9da9d', 'a7c1725f-cce7-4323-bbd3-e92d0a9b8f28', '55e8a616-9e4e-49ca-b4d2-36568049277d', 'a74a8ae1-6b18-4cf1-8db8-84286c5f894e'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:33:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:33:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:33:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:33:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:33:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:55 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:33:55 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Flow 'volume_create_manager' (26109f57-7f7e-4499-bb28-a964a8cbe355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:33:56 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f5531c-07eb-49e5-9365-41f675b7f749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.447s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:33:56 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Deleted volume successfully. Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f5531c-07eb-49e5-9365-41f675b7f749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1925023822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5badc45-b682-4657-b065-e1262b949e2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e68cb64333204a64babaa03cedc8d41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:57Z,use_quota=True,user_id='23194a0d4e5941ceb3d68b9bbb48782d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e020037-9733-4904-805d-2a73df850493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e020037-9733-4904-805d-2a73df850493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f99e66-7321-4bcf-9e3e-3e426696ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f99e66-7321-4bcf-9e3e-3e426696ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5badc45-b682-4657-b065-e1262b949e2a', 'volume_name': 'volume-d5badc45-b682-4657-b065-e1262b949e2a', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d7e89a-01c1-44ee-bf55-6eda9621cdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d7e89a-01c1-44ee-bf55-6eda9621cdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0091969-baa7-40cc-93b7-fafc905ff736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:33:56 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Volume d5badc45-b682-4657-b065-e1262b949e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5badc45-b682-4657-b065-e1262b949e2a', 'volume_size': 1} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:33:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7aef642-03cc-4a20-830d-26c33145798e tempest-VolumesDeleteCascade-2027561428 None] Lock "cinder-a87182bd-acdf-4e40-ad12-088aded8bd91-delete_volume" released by "delete_volume" :: held 3.942s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:33:59 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 29 10:33:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d" returned: 0 in 6.249s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:33:59 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8d187e-50cf-4c0d-83bc-d3f914156cde]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:33:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:33:59 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 Apr 29 10:33:59 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:00 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3" returned: 0 in 0.980s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:00 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:34:00 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Converted 1024.00 MB image at 163.83 MB/s Apr 29 10:34:00 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:34:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:00 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d Apr 29 10:34:00 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:01 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d" returned: 0 in 0.687s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Lock "cinder-quobyte-4ca40613-5f81-453e-a226-9ea88497076d" released by "_copy_volume_from_snapshot" :: held 10.056s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Acquiring lock "cinder-quobyte-8337fa65-c16c-4ae9-be60-ff1a2579dadf" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Lock "cinder-quobyte-8337fa65-c16c-4ae9-be60-ff1a2579dadf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Deleting offline snapshot 8337fa65-c16c-4ae9-be60-ff1a2579dadf of volume 3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:34:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] snapshot_file for this snap is: volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:34:01 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f2f815-6bc7-457d-94b2-8e9ce4f53164]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:01 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf Apr 29 10:34:01 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:02 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf" returned: 0 in 0.920s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3786dfab-c627-47ed-a6f4-bb18102585b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:34:02 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[51983dc7-efc6-4c3d-a38d-e5d8af651f55]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:02 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 Apr 29 10:34:02 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:03 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3" returned: 0 in 0.885s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:03 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf Apr 29 10:34:03 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:04 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf" returned: 0 in 0.853s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:04 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf Apr 29 10:34:04 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:04 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e687d8d7-e2e8-4f51-b536-1886b08f8741 tempest-GroupsV320Test-620937735 None] Group tempest-GroupsV320Test-Group-1125404874: creating Apr 29 10:34:04 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e687d8d7-e2e8-4f51-b536-1886b08f8741 tempest-GroupsV320Test-620937735 None] Group tempest-GroupsV320Test-Group-1125404874: created successfully Apr 29 10:34:04 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e687d8d7-e2e8-4f51-b536-1886b08f8741 tempest-GroupsV320Test-620937735 None] Create group completed successfully. Apr 29 10:34:04 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3.8337fa65-c16c-4ae9-be60-ff1a2579dadf" returned: 0 in 0.640s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Lock "cinder-quobyte-8337fa65-c16c-4ae9-be60-ff1a2579dadf" released by "_delete_snapshot" :: held 3.428s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.395s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.111s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1925023822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5badc45-b682-4657-b065-e1262b949e2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e68cb64333204a64babaa03cedc8d41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:33:57Z,use_quota=True,user_id='23194a0d4e5941ceb3d68b9bbb48782d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Creating volume d5badc45-b682-4657-b065-e1262b949e2a {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:34:05 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:05 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a 1073741824 Apr 29 10:34:05 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b16b3f62-5fd4-4114-83ab-b9676fd23a4e tempest-GroupsV314Test-2066637164 None] Create group from source-group-20af2020-ca21-4013-8958-2cdd9f99eac5 completed successfully. Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Acquiring lock "cinder-quobyte-4ca40613-5f81-453e-a226-9ea88497076d" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Lock "cinder-quobyte-4ca40613-5f81-453e-a226-9ea88497076d" acquired by "delete_volume" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dde149d-a847-4c81-af64-f52e1b7e5e84]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:05 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d Apr 29 10:34:05 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:06 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a 1073741824" returned: 0 in 1.011s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:06 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a Apr 29 10:34:06 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-582e40d4-968a-4471-bd68-5428697f0211 tempest-GroupsV320Test-620937735 None] Created reservations ['52deebee-ae69-4f65-83c3-d7a4804f02ba'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-582e40d4-968a-4471-bd68-5428697f0211 tempest-GroupsV320Test-620937735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-582e40d4-968a-4471-bd68-5428697f0211 tempest-GroupsV320Test-620937735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-582e40d4-968a-4471-bd68-5428697f0211 tempest-GroupsV320Test-620937735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:06 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-582e40d4-968a-4471-bd68-5428697f0211 tempest-GroupsV320Test-620937735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-582e40d4-968a-4471-bd68-5428697f0211 tempest-GroupsV320Test-620937735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-582e40d4-968a-4471-bd68-5428697f0211 tempest-GroupsV320Test-620937735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d" returned: 0 in 0.885s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:06 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d Apr 29 10:34:06 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:06 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:34:06 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:07 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a" returned: 0 in 1.091s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0091969-baa7-40cc-93b7-fafc905ff736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5badc45-b682-4657-b065-e1262b949e2a', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b37d3a1-55fa-489b-9287-ea13051e4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:07 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Volume volume-d5badc45-b682-4657-b065-e1262b949e2a (d5badc45-b682-4657-b065-e1262b949e2a): created successfully Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b37d3a1-55fa-489b-9287-ea13051e4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Flow 'volume_create_manager' (26109f57-7f7e-4499-bb28-a964a8cbe355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:07 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-dac3b7a4-13dc-46f3-9ffe-ca2c43d83ce0 tempest-VolumesTestJSON-1441787586 None] Created volume successfully. Apr 29 10:34:07 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-582e40d4-968a-4471-bd68-5428697f0211 tempest-GroupsV320Test-620937735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.918s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-582e40d4-968a-4471-bd68-5428697f0211 tempest-GroupsV320Test-620937735 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:34:07 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-582e40d4-968a-4471-bd68-5428697f0211 tempest-GroupsV320Test-620937735 None] Delete group completed successfully. Apr 29 10:34:07 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4ca40613-5f81-453e-a226-9ea88497076d" returned: 0 in 0.945s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Lock "cinder-quobyte-4ca40613-5f81-453e-a226-9ea88497076d" released by "delete_volume" :: held 1.885s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Created reservations ['51f1bd05-3c5e-41a9-9aef-b626b91d3e78'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:07 devstack cinder-volume[83806]: WARNING cinder.quota [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1254441582 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1254441582, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:34:07 devstack cinder-volume[83806]: WARNING cinder.quota [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1254441582 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1254441582, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Created reservations ['298d7714-e66f-49ed-a8e4-ff505fd384fb', 'e82b1a94-ec25-4c21-a94d-935a5223ac0e', 'b4f4ea2e-8f6b-4af6-8529-e6bc3f00ab22', '83e8c114-2eaa-40a1-a39f-d7067d97524c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:08 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:34:08 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Flow 'volume_create_manager' (e4e90622-127e-4979-a687-98a9825552d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac365a67-59ec-43eb-92b5-4fa0de04db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac365a67-59ec-43eb-92b5-4fa0de04db83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-566748424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e848a7b-5de2-4566-8233-f908c52754f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e68cb64333204a64babaa03cedc8d41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:08Z,use_quota=True,user_id='23194a0d4e5941ceb3d68b9bbb48782d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998d5c2c-5fc0-4a8b-822d-40226f28aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998d5c2c-5fc0-4a8b-822d-40226f28aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3368beed-d40b-4418-b17d-8ce78bdcb75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3368beed-d40b-4418-b17d-8ce78bdcb75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e848a7b-5de2-4566-8233-f908c52754f6', 'volume_name': 'volume-1e848a7b-5de2-4566-8233-f908c52754f6', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8042c66-806e-4f61-950b-2d5c5d59e395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8042c66-806e-4f61-950b-2d5c5d59e395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c868cba9-6b04-4ce6-a217-52bd3befb770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:08 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Volume 1e848a7b-5de2-4566-8233-f908c52754f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e848a7b-5de2-4566-8233-f908c52754f6', 'volume_size': 1} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-566748424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e848a7b-5de2-4566-8233-f908c52754f6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e68cb64333204a64babaa03cedc8d41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:08Z,use_quota=True,user_id='23194a0d4e5941ceb3d68b9bbb48782d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Creating volume 1e848a7b-5de2-4566-8233-f908c52754f6 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:34:08 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:08 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6 1073741824 Apr 29 10:34:08 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Acquiring lock "cinder-quobyte-3786dfab-c627-47ed-a6f4-bb18102585b3" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Lock "cinder-quobyte-3786dfab-c627-47ed-a6f4-bb18102585b3" acquired by "delete_volume" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ea30e0-1455-460e-88b8-2f542a0a5fba]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:08 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 Apr 29 10:34:08 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:08 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.852s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:08 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:34:08 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6dd822f8-da2a-482a-b347-0e782fe46a8e tempest-GroupsV314Test-2066637164 None] Delete group completed successfully. Apr 29 10:34:09 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:09 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3" returned: 0 in 1.063s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6 1073741824" returned: 0 in 1.285s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:09 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3 Apr 29 10:34:09 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:09 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6 Apr 29 10:34:09 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:10 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6" returned: 0 in 0.807s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:10 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c868cba9-6b04-4ce6-a217-52bd3befb770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e848a7b-5de2-4566-8233-f908c52754f6', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ea7f25-c8a5-4f83-a743-310f537abd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3786dfab-c627-47ed-a6f4-bb18102585b3" returned: 0 in 0.928s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Lock "cinder-quobyte-3786dfab-c627-47ed-a6f4-bb18102585b3" released by "delete_volume" :: held 2.090s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:10 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Volume volume-1e848a7b-5de2-4566-8233-f908c52754f6 (1e848a7b-5de2-4566-8233-f908c52754f6): created successfully Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ea7f25-c8a5-4f83-a743-310f537abd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Flow 'volume_create_manager' (e4e90622-127e-4979-a687-98a9825552d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:10 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-03b7ac43-a574-4347-a6e1-91abb6912e44 tempest-VolumesTestJSON-1441787586 None] Created volume successfully. Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Created reservations ['8e62407b-38a7-4629-b39d-c5db2e8bf51f'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Created reservations ['d303668a-e729-4268-bad4-cbb7a98cadfe', '868c66a1-577f-4c45-b6eb-fa7a0e9f0fd9', '92332abf-c740-4e12-81cf-b6dece9e3519', '624b36ed-1dc9-45e4-a4cb-1f32af456891'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:10 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:34:10 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:11 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.731s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:11 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:34:11 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f9ad287c-00d7-462e-831f-636b09a64858 tempest-GroupsV314Test-2066637164 None] Delete group completed successfully. Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Flow 'volume_create_manager' (2f67e8a4-c4cb-4918-9366-4c0370f4b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1cd7bd-d6f2-4b2e-8330-ef4d0e1ad79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1cd7bd-d6f2-4b2e-8330-ef4d0e1ad79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-779072136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96857b5f-b266-43fb-9806-2bb5faea8eae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e68cb64333204a64babaa03cedc8d41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:12Z,use_quota=True,user_id='23194a0d4e5941ceb3d68b9bbb48782d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bffc5aa-f1ac-4c25-87f7-8a27aba3957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bffc5aa-f1ac-4c25-87f7-8a27aba3957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32087f8b-9fd3-48ea-95ae-24a50bebb695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32087f8b-9fd3-48ea-95ae-24a50bebb695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96857b5f-b266-43fb-9806-2bb5faea8eae', 'volume_name': 'volume-96857b5f-b266-43fb-9806-2bb5faea8eae', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fa06e1-9598-43af-93f0-402150855a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fa06e1-9598-43af-93f0-402150855a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc8256f-6f0d-4655-acfc-dc9ca76d10cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:12 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Volume 96857b5f-b266-43fb-9806-2bb5faea8eae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96857b5f-b266-43fb-9806-2bb5faea8eae', 'volume_size': 1} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-779072136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96857b5f-b266-43fb-9806-2bb5faea8eae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e68cb64333204a64babaa03cedc8d41a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:12Z,use_quota=True,user_id='23194a0d4e5941ceb3d68b9bbb48782d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Creating volume 96857b5f-b266-43fb-9806-2bb5faea8eae {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:34:12 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:34:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:12 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae 1073741824 Apr 29 10:34:12 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:13 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae 1073741824" returned: 0 in 1.037s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:13 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae Apr 29 10:34:13 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:14 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae" returned: 0 in 1.002s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:34:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc8256f-6f0d-4655-acfc-dc9ca76d10cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96857b5f-b266-43fb-9806-2bb5faea8eae', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52190240-b921-4df4-8de7-fd8213dccd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:14 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Volume volume-96857b5f-b266-43fb-9806-2bb5faea8eae (96857b5f-b266-43fb-9806-2bb5faea8eae): created successfully Apr 29 10:34:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52190240-b921-4df4-8de7-fd8213dccd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Flow 'volume_create_manager' (2f67e8a4-c4cb-4918-9366-4c0370f4b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:14 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=122,cinder:UPDATE=143,cinder:INSERT=36,cinder:DELETE=6 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:34:14 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7c86ebf3-666a-444e-ad7c-221e35b3cdb2 tempest-VolumesTestJSON-1441787586 None] Created volume successfully. Apr 29 10:34:14 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=157,cinder:DELETE=12,cinder:SELECT=125,cinder:INSERT=35 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Flow 'volume_create_manager' (4af89dea-946d-49fe-96de-ab54c205f12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f2ef60-d97b-490a-b86c-d93291e78702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f2ef60-d97b-490a-b86c-d93291e78702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1538727907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef93aca-7c6c-4742-8409-9078301f05b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823592ff7d1a44fb865c9d04506b576f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:16Z,use_quota=True,user_id='fab4fa62da4d4eabb614e122e4f9434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c712e813-3e40-471a-b954-7f49c21a29c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c712e813-3e40-471a-b954-7f49c21a29c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c52a7bd-8e0a-49c5-9c05-adca6d2b32a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c52a7bd-8e0a-49c5-9c05-adca6d2b32a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef93aca-7c6c-4742-8409-9078301f05b5', 'volume_name': 'volume-1ef93aca-7c6c-4742-8409-9078301f05b5', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f83cf82-53c8-44f6-9d7f-ab82970fd5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f83cf82-53c8-44f6-9d7f-ab82970fd5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4143d0-2e8d-4a72-99ca-432caa95d5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:15 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Volume 1ef93aca-7c6c-4742-8409-9078301f05b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef93aca-7c6c-4742-8409-9078301f05b5', 'volume_size': 1} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1538727907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef93aca-7c6c-4742-8409-9078301f05b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823592ff7d1a44fb865c9d04506b576f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:16Z,use_quota=True,user_id='fab4fa62da4d4eabb614e122e4f9434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Creating volume 1ef93aca-7c6c-4742-8409-9078301f05b5 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:34:15 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:34:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:15 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 1073741824 Apr 29 10:34:15 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:16 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 1073741824" returned: 0 in 0.998s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:16 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 Apr 29 10:34:16 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "cinder-96857b5f-b266-43fb-9806-2bb5faea8eae-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-96857b5f-b266-43fb-9806-2bb5faea8eae-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "cinder-quobyte-96857b5f-b266-43fb-9806-2bb5faea8eae" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-quobyte-96857b5f-b266-43fb-9806-2bb5faea8eae" acquired by "delete_volume" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb3b409-9b93-44b5-a877-a66a1eedec09]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:17 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae Apr 29 10:34:17 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:17 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5" returned: 0 in 0.828s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4143d0-2e8d-4a72-99ca-432caa95d5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef93aca-7c6c-4742-8409-9078301f05b5', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2256f3a-6832-41d5-b428-abb9b9a7bb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:17 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Volume volume-1ef93aca-7c6c-4742-8409-9078301f05b5 (1ef93aca-7c6c-4742-8409-9078301f05b5): created successfully Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2256f3a-6832-41d5-b428-abb9b9a7bb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Flow 'volume_create_manager' (4af89dea-946d-49fe-96de-ab54c205f12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:17 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6a32e18f-9fde-483c-8d9e-f266782dcd1b tempest-VolumesActionsTest-2116014960 None] Created volume successfully. Apr 29 10:34:18 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae" returned: 0 in 0.953s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:18 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae Apr 29 10:34:18 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:18 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-96857b5f-b266-43fb-9806-2bb5faea8eae" returned: 0 in 0.584s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-quobyte-96857b5f-b266-43fb-9806-2bb5faea8eae" released by "delete_volume" :: held 1.589s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Created reservations ['ed536b81-e2a1-4eeb-ba5e-1c9349d56123', '5b41927d-5e88-47b5-8f82-dd9928804561', '0a6808bf-cf91-4fec-b08b-38b223663597', 'd4df4e87-d5d4-4551-b908-f06852d0e55a'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:18 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:34:18 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "cinder-1e848a7b-5de2-4566-8233-f908c52754f6-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-1e848a7b-5de2-4566-8233-f908c52754f6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "cinder-quobyte-1e848a7b-5de2-4566-8233-f908c52754f6" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-quobyte-1e848a7b-5de2-4566-8233-f908c52754f6" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:19 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7fa4d7-ceae-4610-9c16-564b068ca2b9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:19 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6 Apr 29 10:34:19 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:19 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.895s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:19 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:34:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Deleted volume successfully. Apr 29 10:34:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9427220a-3a91-461e-be5a-5aba356d1d02 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-96857b5f-b266-43fb-9806-2bb5faea8eae-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:20 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6" returned: 0 in 0.997s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:20 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6 Apr 29 10:34:20 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:21 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1e848a7b-5de2-4566-8233-f908c52754f6" returned: 0 in 0.733s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-quobyte-1e848a7b-5de2-4566-8233-f908c52754f6" released by "delete_volume" :: held 1.814s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Created reservations ['450e9440-2431-4c12-85d8-6d382af6c119', '126bd145-e8b7-4489-9752-21df5ec47483', '50f8b079-8db9-49c8-a730-3b96007738fc', '3a9bd6aa-0aec-415e-a185-0ef04d27f364'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:21 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:34:21 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "cinder-d5badc45-b682-4657-b065-e1262b949e2a-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-d5badc45-b682-4657-b065-e1262b949e2a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "cinder-quobyte-d5badc45-b682-4657-b065-e1262b949e2a" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-quobyte-d5badc45-b682-4657-b065-e1262b949e2a" acquired by "delete_volume" :: waited 0.033s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cb7aba-e7d3-4cbc-bcdb-4d6d2808aba8]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:22 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a Apr 29 10:34:22 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:22 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.885s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:22 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:34:22 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Deleted volume successfully. Apr 29 10:34:22 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4aa5d362-f7a0-4477-8bd2-9736fa8d0ea0 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-1e848a7b-5de2-4566-8233-f908c52754f6-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:22 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a" returned: 0 in 0.905s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:22 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a Apr 29 10:34:22 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:23 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d5badc45-b682-4657-b065-e1262b949e2a" returned: 0 in 0.795s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-quobyte-d5badc45-b682-4657-b065-e1262b949e2a" released by "delete_volume" :: held 1.770s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:23 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Created reservations ['7a028ea3-1a35-4d30-895f-b2202a258710', 'f6d91985-c0a2-40a0-b06c-f43fd7a5c06c', '4da9c65f-b0d0-4b39-a7a0-59c3363601f4', '39fae4c8-0b87-44ca-8e81-5cb93049e73c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:23 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:34:23 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:24 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.852s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:24 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:34:24 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Deleted volume successfully. Apr 29 10:34:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-170c2b4d-2199-429f-9f6d-3924493d5fc1 tempest-VolumesTestJSON-1441787586 None] Lock "cinder-d5badc45-b682-4657-b065-e1262b949e2a-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Flow 'volume_create_manager' (3522df65-a599-4487-ac78-55065e799a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5a0331-a4bb-45eb-bfef-9ddf82f1fe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5a0331-a4bb-45eb-bfef-9ddf82f1fe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1217311617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb411ee-eb1d-4c17-912b-8f8315417fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d6f1c20b774d5886636c2a265ac8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:28Z,use_quota=True,user_id='489031542c0543b6838b8ae2363108c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5696823-fd80-4566-bff3-f6bb1c2e5215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5696823-fd80-4566-bff3-f6bb1c2e5215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209bdfd6-68ae-4c0a-8fed-cb9ec91eaaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209bdfd6-68ae-4c0a-8fed-cb9ec91eaaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb411ee-eb1d-4c17-912b-8f8315417fc3', 'volume_name': 'volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c7bf14-4986-412a-ace2-2fd9d08fbafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c7bf14-4986-412a-ace2-2fd9d08fbafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5dbc44e-c127-4511-bfea-60570a19b7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:28 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Volume 1bb411ee-eb1d-4c17-912b-8f8315417fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3', 'volume_size': 1} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1217311617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb411ee-eb1d-4c17-912b-8f8315417fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d6f1c20b774d5886636c2a265ac8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:28Z,use_quota=True,user_id='489031542c0543b6838b8ae2363108c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Creating volume 1bb411ee-eb1d-4c17-912b-8f8315417fc3 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:34:28 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:34:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:28 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3 1073741824 Apr 29 10:34:28 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:29 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3 1073741824" returned: 0 in 1.259s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:29 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3 Apr 29 10:34:29 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9b5b3444-8f6b-4ba3-b59d-320ca045c454 tempest-GroupSnapshotsV319Test-1570868364 None] Group tempest-GroupSnapshotsV319Test-Group-1741624280: creating Apr 29 10:34:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9b5b3444-8f6b-4ba3-b59d-320ca045c454 tempest-GroupSnapshotsV319Test-1570868364 None] Group tempest-GroupSnapshotsV319Test-Group-1741624280: created successfully Apr 29 10:34:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9b5b3444-8f6b-4ba3-b59d-320ca045c454 tempest-GroupSnapshotsV319Test-1570868364 None] Create group completed successfully. Apr 29 10:34:30 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3" returned: 0 in 0.657s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:34:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5dbc44e-c127-4511-bfea-60570a19b7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218b1d6f-7a82-40b3-af7d-75b2488a9257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:30 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Volume volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3 (1bb411ee-eb1d-4c17-912b-8f8315417fc3): created successfully Apr 29 10:34:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218b1d6f-7a82-40b3-af7d-75b2488a9257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Flow 'volume_create_manager' (3522df65-a599-4487-ac78-55065e799a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:30 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d834e234-06a0-4bd1-bf58-477e34e5ea0e tempest-VolumeQuotasNegativeTestJSON-396779533 None] Created volume successfully. Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Flow 'volume_create_manager' (61b2fd92-85af-4ebf-8d77-ead329c1cede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211d2f92-c98a-4592-b841-896a51e32ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211d2f92-c98a-4592-b841-896a51e32ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033535208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ef7f349-0c24-42d2-b9de-1f75fe7a407e,host='devstack@QuobyteHD#QuobyteHD',id=df927733-2af9-499d-9904-2b90828b1e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfe8cb528f04e12982a86adbad0db62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:31Z,use_quota=True,user_id='40a2decd320e4ef0afb518c288b7e42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e4fbad6-e365-43e3-8c9c-fa680f7a6df7),volume_type_id=1e4fbad6-e365-43e3-8c9c-fa680f7a6df7)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc5d2d3-6be7-4043-b999-8d7a47bb9462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc5d2d3-6be7-4043-b999-8d7a47bb9462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db04eb2-a059-46ef-9fbb-3a685021ca61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db04eb2-a059-46ef-9fbb-3a685021ca61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df927733-2af9-499d-9904-2b90828b1e18', 'volume_name': 'volume-df927733-2af9-499d-9904-2b90828b1e18', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4544fb40-1e7d-43d6-ad83-f6442bc0f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4544fb40-1e7d-43d6-ad83-f6442bc0f44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6c86c6-92db-4fd6-b325-024c8337f115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:31 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Volume df927733-2af9-499d-9904-2b90828b1e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df927733-2af9-499d-9904-2b90828b1e18', 'volume_size': 1} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ef7f349-0c24-42d2-b9de-1f75fe7a407e,created_at=2026-04-29T08:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033535208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ef7f349-0c24-42d2-b9de-1f75fe7a407e,host='devstack@QuobyteHD#QuobyteHD',id=df927733-2af9-499d-9904-2b90828b1e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfe8cb528f04e12982a86adbad0db62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:31Z,use_quota=True,user_id='40a2decd320e4ef0afb518c288b7e42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e4fbad6-e365-43e3-8c9c-fa680f7a6df7),volume_type_id=1e4fbad6-e365-43e3-8c9c-fa680f7a6df7)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Creating volume df927733-2af9-499d-9904-2b90828b1e18 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:34:31 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:34:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:31 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 1073741824 Apr 29 10:34:31 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:32 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 1073741824" returned: 0 in 1.148s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Acquiring lock "cinder-1bb411ee-eb1d-4c17-912b-8f8315417fc3-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Lock "cinder-1bb411ee-eb1d-4c17-912b-8f8315417fc3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:32 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 Apr 29 10:34:32 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Acquiring lock "cinder-quobyte-1bb411ee-eb1d-4c17-912b-8f8315417fc3" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Lock "cinder-quobyte-1bb411ee-eb1d-4c17-912b-8f8315417fc3" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:32 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[228802fc-f94e-4895-a8d4-4c51c261f4b0]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:32 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3 Apr 29 10:34:32 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:33 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:34:33 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:33 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18" returned: 0 in 0.686s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6c86c6-92db-4fd6-b325-024c8337f115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df927733-2af9-499d-9904-2b90828b1e18', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea03bb78-c7e6-4dfa-b15c-ef0f07fec85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:33 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Volume volume-df927733-2af9-499d-9904-2b90828b1e18 (df927733-2af9-499d-9904-2b90828b1e18): created successfully Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea03bb78-c7e6-4dfa-b15c-ef0f07fec85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Flow 'volume_create_manager' (61b2fd92-85af-4ebf-8d77-ead329c1cede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:33 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6cf691d0-df57-4dfb-9b5c-ef3c8768e95e tempest-GroupSnapshotsV319Test-1570868364 None] Created volume successfully. Apr 29 10:34:33 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3" returned: 0 in 0.967s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:33 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3 Apr 29 10:34:33 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:33 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.755s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:34:33 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] GroupSnapshot 308ea574-8ccb-4706-91f8-bb845a055cf1: creating. Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Group snapshot 308ea574-8ccb-4706-91f8-bb845a055cf1: creating. {{(pid=83806) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Creating offline snapshot 9c274150-e3ac-46e1-a2f8-9664b9bd7b6e of volume df927733-2af9-499d-9904-2b90828b1e18 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeb0948-4755-4bac-ab09-0a4cd8c0f8d1]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:34 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 Apr 29 10:34:34 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:34 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1bb411ee-eb1d-4c17-912b-8f8315417fc3" returned: 0 in 0.694s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Lock "cinder-quobyte-1bb411ee-eb1d-4c17-912b-8f8315417fc3" released by "delete_volume" :: held 1.717s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Created reservations ['59e5f3b8-794e-4948-a935-a7a8841dbce9', '28581119-6a73-47f2-9f55-2928731b32c4', 'f6b35534-4f7f-4871-b68b-2bc71f16d118', 'dd721b08-018e-4676-b794-3eaf549dadd7'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:34 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:34:34 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:35 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18" returned: 0 in 1.096s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:35 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e 1G Apr 29 10:34:35 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:35 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.445s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:35 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:34:35 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Deleted volume successfully. Apr 29 10:34:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-eddf1825-51cb-4283-bd57-025488653368 tempest-VolumeQuotasNegativeTestJSON-396779533 None] Lock "cinder-1bb411ee-eb1d-4c17-912b-8f8315417fc3-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:36 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e 1G" returned: 0 in 1.627s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df927733-2af9-499d-9904-2b90828b1e18 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:36 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df927733-2af9-499d-9904-2b90828b1e18 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e Apr 29 10:34:36 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:38 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df927733-2af9-499d-9904-2b90828b1e18 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e" returned: 0 in 1.308s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:38 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:34:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:38 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e Apr 29 10:34:38 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d88a31bb-81a9-438b-aaee-b9ac6b458928 tempest-VolumesActionsTest-2116014960 None] Acquiring lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5" by "attach_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d88a31bb-81a9-438b-aaee-b9ac6b458928 tempest-VolumesActionsTest-2116014960 None] Lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5" acquired by "attach_volume" :: waited 0.034s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:38 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d88a31bb-81a9-438b-aaee-b9ac6b458928 tempest-VolumesActionsTest-2116014960 None] Attaching volume 1ef93aca-7c6c-4742-8409-9078301f05b5 to instance af7e29e2-140e-4672-9e27-73cb5dd9784d at mountpoint /dev/vdb on host None. Apr 29 10:34:38 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d88a31bb-81a9-438b-aaee-b9ac6b458928 tempest-VolumesActionsTest-2116014960 None] Attach volume completed successfully. Apr 29 10:34:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d88a31bb-81a9-438b-aaee-b9ac6b458928 tempest-VolumesActionsTest-2116014960 None] Lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5" released by "attach_volume" :: held 0.188s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:39 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e" returned: 0 in 1.135s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:39 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.info Apr 29 10:34:39 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d0051e89-8dea-46fd-870c-90b21e992da7 tempest-VolumesActionsTest-2116014960 None] Acquiring lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5-detach_volume" by "detach_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d0051e89-8dea-46fd-870c-90b21e992da7 tempest-VolumesActionsTest-2116014960 None] Lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:39 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d0051e89-8dea-46fd-870c-90b21e992da7 tempest-VolumesActionsTest-2116014960 None] Detaching volume 1ef93aca-7c6c-4742-8409-9078301f05b5 from instance af7e29e2-140e-4672-9e27-73cb5dd9784d. Apr 29 10:34:39 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d0051e89-8dea-46fd-870c-90b21e992da7 tempest-VolumesActionsTest-2116014960 None] Detach volume completed successfully. Apr 29 10:34:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d0051e89-8dea-46fd-870c-90b21e992da7 tempest-VolumesActionsTest-2116014960 None] Lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:40 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.info" returned: 0 in 0.828s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:40 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 10:34:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:40 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.info Apr 29 10:34:40 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:40 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.info" returned: 0 in 0.946s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.075s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:41 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-ad1b8910-fe59-408a-b144-7abd50e2386b tempest-GroupSnapshotsV319Test-1570868364 None] group_snapshot 308ea574-8ccb-4706-91f8-bb845a055cf1: created successfully Apr 29 10:34:42 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] group_snapshot 308ea574-8ccb-4706-91f8-bb845a055cf1: deleting Apr 29 10:34:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] group_snapshot 308ea574-8ccb-4706-91f8-bb845a055cf1: deleting {{(pid=83806) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 10:34:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Acquiring lock "cinder-quobyte-df927733-2af9-499d-9904-2b90828b1e18" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Lock "cinder-quobyte-df927733-2af9-499d-9904-2b90828b1e18" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Acquiring lock "cinder-quobyte-9c274150-e3ac-46e1-a2f8-9664b9bd7b6e" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Lock "cinder-quobyte-9c274150-e3ac-46e1-a2f8-9664b9bd7b6e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Deleting offline snapshot 9c274150-e3ac-46e1-a2f8-9664b9bd7b6e of volume df927733-2af9-499d-9904-2b90828b1e18 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:34:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] snapshot_file for this snap is: volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:34:42 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fac8d5-5ed1-4397-a658-d793e861a077]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:42 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e Apr 29 10:34:42 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:43 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e" returned: 0 in 0.861s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df927733-2af9-499d-9904-2b90828b1e18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeda69e-92a0-43f1-bde4-ebbca28a949d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:43 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 Apr 29 10:34:43 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Flow 'volume_create_manager' (acaa498a-7b86-4241-8905-c7ddccb8ac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7731065d-bc0a-46a6-bc91-047a8b1b0cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7731065d-bc0a-46a6-bc91-047a8b1b0cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1208419543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685afcda-4699-4423-a111-3d287cb4951d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584a25b927a2462bb172bd161dfdfcb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:44Z,use_quota=True,user_id='270869bd7eca497ead741d09b9801fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(522b02af-512a-4aa4-8c91-bee032317007),volume_type_id=522b02af-512a-4aa4-8c91-bee032317007)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37aedfca-7fb8-4365-beaa-58ff8231633d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37aedfca-7fb8-4365-beaa-58ff8231633d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aede9fb7-71ce-4b87-98e2-de0daa24ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aede9fb7-71ce-4b87-98e2-de0daa24ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685afcda-4699-4423-a111-3d287cb4951d', 'volume_name': 'volume-685afcda-4699-4423-a111-3d287cb4951d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a0126e-8e89-4524-b94f-403e867a072a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a0126e-8e89-4524-b94f-403e867a072a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598e4ee2-921f-49e3-a11f-14bc0f8e1710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:44 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Volume 685afcda-4699-4423-a111-3d287cb4951d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685afcda-4699-4423-a111-3d287cb4951d', 'volume_size': 1} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1208419543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685afcda-4699-4423-a111-3d287cb4951d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584a25b927a2462bb172bd161dfdfcb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:44Z,use_quota=True,user_id='270869bd7eca497ead741d09b9801fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(522b02af-512a-4aa4-8c91-bee032317007),volume_type_id=522b02af-512a-4aa4-8c91-bee032317007)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Creating volume 685afcda-4699-4423-a111-3d287cb4951d {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:34:44 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:44 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d 1073741824 Apr 29 10:34:44 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Flow 'volume_create_manager' (a5fa150a-b551-4906-8473-aca0aa66ad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8236d247-214c-45fb-ba7a-5d6954ec8a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8236d247-214c-45fb-ba7a-5d6954ec8a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-52314401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb13514c-6ab4-4faa-8e79-0dc6d7094ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290f0d78b08d4787832b194d58b33130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:44Z,use_quota=True,user_id='af7feb06e40f4c7ab6baf3f5cecc3a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d97116-e536-4c96-98a7-4ebdaf759fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d97116-e536-4c96-98a7-4ebdaf759fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d70b125-29de-4b0b-a365-378002aabc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d70b125-29de-4b0b-a365-378002aabc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb13514c-6ab4-4faa-8e79-0dc6d7094ab2', 'volume_name': 'volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb495e5b-9839-472c-81d0-e872d033d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb495e5b-9839-472c-81d0-e872d033d079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c0d80e-4197-48fe-b089-41191db3c9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:44 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Volume fb13514c-6ab4-4faa-8e79-0dc6d7094ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2', 'volume_size': 1} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:44 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18" returned: 0 in 1.019s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:44 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e Apr 29 10:34:44 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:44 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d 1073741824" returned: 0 in 0.890s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:44 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d Apr 29 10:34:44 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:45 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e" returned: 0 in 0.718s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:45 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e Apr 29 10:34:45 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:45 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d" returned: 0 in 0.601s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-52314401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb13514c-6ab4-4faa-8e79-0dc6d7094ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290f0d78b08d4787832b194d58b33130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:44Z,use_quota=True,user_id='af7feb06e40f4c7ab6baf3f5cecc3a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Creating volume fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:34:45 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:45 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 1073741824 Apr 29 10:34:45 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598e4ee2-921f-49e3-a11f-14bc0f8e1710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685afcda-4699-4423-a111-3d287cb4951d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd3427e-b9cc-40c4-87ca-4bcb1cf9c0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:45 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Volume volume-685afcda-4699-4423-a111-3d287cb4951d (685afcda-4699-4423-a111-3d287cb4951d): created successfully Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd3427e-b9cc-40c4-87ca-4bcb1cf9c0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Flow 'volume_create_manager' (acaa498a-7b86-4241-8905-c7ddccb8ac44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:45 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-eda5522f-bc70-492f-8dd0-f9c23e9b0fd0 tempest-VolumeTypesAccessTest-2108328934 None] Created volume successfully. Apr 29 10:34:45 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18.9c274150-e3ac-46e1-a2f8-9664b9bd7b6e" returned: 0 in 0.629s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Lock "cinder-quobyte-9c274150-e3ac-46e1-a2f8-9664b9bd7b6e" released by "_delete_snapshot" :: held 3.436s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Lock "cinder-quobyte-df927733-2af9-499d-9904-2b90828b1e18" released by "delete_snapshot" :: held 3.471s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:46 devstack cinder-volume[83806]: WARNING cinder.quota [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-376526607 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-376526607, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:34:46 devstack cinder-volume[83806]: WARNING cinder.quota [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-376526607 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-376526607, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] Created reservations ['d72d2f7a-ce06-4393-a39a-621d2e3adb91', '0ac2daf9-5691-4852-9be6-bb2ee2a7b7f0', '586202fb-47cf-4291-a554-d43145392f5c', '0d069ee6-0df7-4bc9-87e9-89c8fdcd168e'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Acquiring lock "cinder-685afcda-4699-4423-a111-3d287cb4951d-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Lock "cinder-685afcda-4699-4423-a111-3d287cb4951d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Acquiring lock "cinder-quobyte-685afcda-4699-4423-a111-3d287cb4951d" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:46 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4d59fff9-6cc4-42a9-bed1-b60d8f2c651f tempest-GroupSnapshotsV319Test-1570868364 None] group_snapshot 308ea574-8ccb-4706-91f8-bb845a055cf1: deleted successfully Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Lock "cinder-quobyte-685afcda-4699-4423-a111-3d287cb4951d" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ffd137-4dde-4c8a-82e3-ba0817d548a5]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:46 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d Apr 29 10:34:46 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:46 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 1073741824" returned: 0 in 0.899s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:46 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 Apr 29 10:34:46 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:46 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d" returned: 0 in 0.757s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:46 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d Apr 29 10:34:46 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Acquiring lock "cinder-quobyte-df927733-2af9-499d-9904-2b90828b1e18" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Lock "cinder-quobyte-df927733-2af9-499d-9904-2b90828b1e18" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42d6533-37b7-48d0-900c-4147b33ba1db]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:47 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" returned: 0 in 0.784s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c0d80e-4197-48fe-b089-41191db3c9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb346732-7ad2-4e93-be22-2289eee8e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:47 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 Apr 29 10:34:47 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:47 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Volume volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 (fb13514c-6ab4-4faa-8e79-0dc6d7094ab2): created successfully Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb346732-7ad2-4e93-be22-2289eee8e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Flow 'volume_create_manager' (a5fa150a-b551-4906-8473-aca0aa66ad35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:47 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-1df079fa-189f-4c0d-85bb-d14ac99d04b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Created volume successfully. Apr 29 10:34:47 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-685afcda-4699-4423-a111-3d287cb4951d" returned: 0 in 0.671s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Lock "cinder-quobyte-685afcda-4699-4423-a111-3d287cb4951d" released by "delete_volume" :: held 1.469s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:47 devstack cinder-volume[83806]: WARNING cinder.quota [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-314141964 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-314141964, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:34:47 devstack cinder-volume[83806]: WARNING cinder.quota [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-314141964 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-314141964, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Created reservations ['fe798acf-a806-4cea-be79-6bba41e7eb68', '0a74b8d7-51f7-4787-9fc9-f98b9d57e880', '31a2c972-0f76-4c36-bbef-ca438b4f37e4', 'd0bcf47e-f7a1-4084-b3b8-9ff208b3dc97'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:47 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:34:47 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:47 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18" returned: 0 in 0.805s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:48 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18 Apr 29 10:34:48 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:48 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.756s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:34:48 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Deleted volume successfully. Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2f1316cc-77c2-4afe-9872-44c62d7494a0 tempest-VolumeTypesAccessTest-2108328934 None] Lock "cinder-685afcda-4699-4423-a111-3d287cb4951d-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Creating offline snapshot 3ff7b405-5cf0-46b0-95f3-c393e5408472 of volume fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe8ad43-db4f-46e9-9784-f43508d95ab9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:48 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 Apr 29 10:34:48 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:48 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-df927733-2af9-499d-9904-2b90828b1e18" returned: 0 in 0.793s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Lock "cinder-quobyte-df927733-2af9-499d-9904-2b90828b1e18" released by "delete_volume" :: held 1.716s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Created reservations ['5ce5d33b-dd4c-4e20-af64-e15dfec7782a'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:48 devstack cinder-volume[83806]: WARNING cinder.quota [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-376526607 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-376526607, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:34:48 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Created reservations ['f435c85d-a868-458f-98e3-2ef825e591e6', '1e50cbfa-c49e-4329-9fa5-1d58079a63f7', '60291e96-6117-46c3-8436-a3d786528f33', 'd20de070-6250-403f-91ce-976f40589585'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:49 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:34:49 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:49 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" returned: 0 in 0.831s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:49 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 1G Apr 29 10:34:49 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:49 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.753s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:49 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:34:49 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7211a5ee-5bb5-4a72-b921-0d591090b5fd tempest-GroupSnapshotsV319Test-1570868364 None] Delete group completed successfully. Apr 29 10:34:50 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 1G" returned: 0 in 0.921s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:50 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 Apr 29 10:34:50 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:51 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472" returned: 0 in 0.743s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:51 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 is being set with open permissions: ugo+rw Apr 29 10:34:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:51 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 Apr 29 10:34:51 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:51 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472" returned: 0 in 0.825s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:52 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.info Apr 29 10:34:52 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:52 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.info" returned: 0 in 0.742s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:52 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.info is being set with open permissions: ugo+rw Apr 29 10:34:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:52 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.info Apr 29 10:34:52 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:53 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.info" returned: 0 in 0.810s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.041s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:53 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-03310071-7692-455c-ae80-d8dd1fbfc7e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Create snapshot completed successfully Apr 29 10:34:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Acquiring lock "cinder-3ff7b405-5cf0-46b0-95f3-c393e5408472-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "cinder-3ff7b405-5cf0-46b0-95f3-c393e5408472-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Acquiring lock "cinder-quobyte-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "cinder-quobyte-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Acquiring lock "cinder-quobyte-3ff7b405-5cf0-46b0-95f3-c393e5408472" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "cinder-quobyte-3ff7b405-5cf0-46b0-95f3-c393e5408472" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Deleting offline snapshot 3ff7b405-5cf0-46b0-95f3-c393e5408472 of volume fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:34:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] snapshot_file for this snap is: volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:34:54 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb7afbf-9010-4a9f-9e51-2de40a2a5e43]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:54 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 Apr 29 10:34:54 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:55 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472" returned: 0 in 0.761s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:34:55 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0e2eea-f8ab-4756-bd71-7c326ef64e0b]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:55 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 Apr 29 10:34:55 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Flow 'volume_create_manager' (761dd2d6-ed29-41f9-806b-1d5566a9980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88cf78d-ca49-4a45-a227-4cc6301a793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88cf78d-ca49-4a45-a227-4cc6301a793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-948002636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d42fe1a-55ae-4574-8417-75ae085e8ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6133070af7ef493ea3969c9a5e31455f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:56Z,use_quota=True,user_id='98964c9c041e4fd5a99de35c1ba6bff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:56 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5aa0f4-9fe7-4bf0-9fe7-2626415d655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5aa0f4-9fe7-4bf0-9fe7-2626415d655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da04a52-aefa-47cc-92ce-70ed3325f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da04a52-aefa-47cc-92ce-70ed3325f39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d42fe1a-55ae-4574-8417-75ae085e8ead', 'volume_name': 'volume-4d42fe1a-55ae-4574-8417-75ae085e8ead', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b138bb1-c04d-48d6-8d52-3c51fab34f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b138bb1-c04d-48d6-8d52-3c51fab34f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0921957-0751-4702-be40-dbbd5715f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:56 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Volume 4d42fe1a-55ae-4574-8417-75ae085e8ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d42fe1a-55ae-4574-8417-75ae085e8ead', 'volume_size': 1} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-948002636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d42fe1a-55ae-4574-8417-75ae085e8ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6133070af7ef493ea3969c9a5e31455f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:34:56Z,use_quota=True,user_id='98964c9c041e4fd5a99de35c1ba6bff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Creating volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:34:56 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" returned: 0 in 1.069s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:56 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead 1073741824 Apr 29 10:34:56 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:56 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 Apr 29 10:34:56 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:57 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472" returned: 0 in 0.979s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:57 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472 Apr 29 10:34:57 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:57 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead 1073741824" returned: 0 in 1.153s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:57 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead Apr 29 10:34:57 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:58 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2.3ff7b405-5cf0-46b0-95f3-c393e5408472" returned: 0 in 0.854s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "cinder-quobyte-3ff7b405-5cf0-46b0-95f3-c393e5408472" released by "_delete_snapshot" :: held 3.802s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "cinder-quobyte-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" released by "delete_snapshot" :: held 3.836s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Created reservations ['784da130-47be-41a1-8216-d4990e97fe4a', 'cf706dc0-1833-4fea-b9c0-1ece0e3077c2', 'd8ed8672-a7a6-4d1a-9089-ca2261290875', 'e6efafb7-1cef-4a3f-a1ff-cb21fec5adef'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:34:58 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead" returned: 0 in 1.014s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:34:58 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Delete snapshot completed successfully. Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2550d5f1-a722-4847-96bb-f76dd2f202f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "cinder-3ff7b405-5cf0-46b0-95f3-c393e5408472-delete_snapshot" released by "delete_snapshot" :: held 4.150s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0921957-0751-4702-be40-dbbd5715f15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d42fe1a-55ae-4574-8417-75ae085e8ead', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f668c2a-bd9f-48cc-8d77-5062998cc456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:34:58 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Volume volume-4d42fe1a-55ae-4574-8417-75ae085e8ead (4d42fe1a-55ae-4574-8417-75ae085e8ead): created successfully Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f668c2a-bd9f-48cc-8d77-5062998cc456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Flow 'volume_create_manager' (761dd2d6-ed29-41f9-806b-1d5566a9980d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:34:58 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f47a0dbd-d74e-4060-8645-b1fa3e45878b tempest-SnapshotsActionsTest-806442688 None] Created volume successfully. Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Acquiring lock "cinder-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "cinder-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Acquiring lock "cinder-quobyte-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "cinder-quobyte-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e94a5aa-87a0-45e0-ba03-91ee4f58741e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:59 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 Apr 29 10:34:59 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:34:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:34:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:34:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Creating offline snapshot 49c96b8b-dbab-47c4-806c-1947f1a7b65b of volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:34:59 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b9873-f824-441d-a0f4-84d23c623964]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:34:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:59 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Apr 29 10:34:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" returned: 0 in 0.937s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:34:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:34:59 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2 Apr 29 10:34:59 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:00 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead Apr 29 10:35:00 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:00 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" returned: 0 in 0.651s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "cinder-quobyte-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2" released by "delete_volume" :: held 1.659s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Created reservations ['65c3035e-15e6-477a-adc3-20236ec7ee15', 'dfa5a648-536a-4c75-8aae-f71fbad3df71', '4067626d-4382-49ce-8f0e-12cf84bae0a0', 'a65838ae-84b5-4a46-b653-9679f6756529'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:35:00 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead" returned: 0 in 0.789s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:00 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b 1G Apr 29 10:35:00 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:00 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:35:00 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:01 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b 1G" returned: 0 in 1.171s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:01 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.109s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:01 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:35:01 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Deleted volume successfully. Apr 29 10:35:01 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:35:01 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d5d014c2-b562-4a7e-a0e3-e202da524af3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2053665827 None] Lock "cinder-fb13514c-6ab4-4faa-8e79-0dc6d7094ab2-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:02 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 0.836s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:02 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b is being set with open permissions: ugo+rw Apr 29 10:35:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:02 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:35:02 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:03 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 0.677s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:03 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.info Apr 29 10:35:03 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:04 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.info" returned: 0 in 0.775s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:04 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.info is being set with open permissions: ugo+rw Apr 29 10:35:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:04 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.info Apr 29 10:35:04 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:04 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.info" returned: 0 in 0.690s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.048s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:04 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-68a56b37-ee87-4ca5-8bea-6ef03a254bfe tempest-SnapshotsActionsTest-806442688 None] Create snapshot completed successfully Apr 29 10:35:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] Creating offline snapshot c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea of volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:35:06 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5cce63-a56d-4cf9-9516-e0ec1124d31a]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:06 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:35:06 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:08 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 1.507s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:35:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:08 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea 1G Apr 29 10:35:08 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:09 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea 1G" returned: 0 in 1.182s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:09 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea Apr 29 10:35:09 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:09 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-fed93027-0b5a-4297-809a-387873f8269b tempest-VolumesActionsTest-2116014960 None] Acquiring lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5" by "attach_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:09 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-fed93027-0b5a-4297-809a-387873f8269b tempest-VolumesActionsTest-2116014960 None] Lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5" acquired by "attach_volume" :: waited 0.044s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:09 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-fed93027-0b5a-4297-809a-387873f8269b tempest-VolumesActionsTest-2116014960 None] Attaching volume 1ef93aca-7c6c-4742-8409-9078301f05b5 to instance 3f7b1868-e411-4123-9f22-e6e0f6d84044 at mountpoint /dev/vdb on host None. Apr 29 10:35:09 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-fed93027-0b5a-4297-809a-387873f8269b tempest-VolumesActionsTest-2116014960 None] Attach volume completed successfully. Apr 29 10:35:09 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-fed93027-0b5a-4297-809a-387873f8269b tempest-VolumesActionsTest-2116014960 None] Lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5" released by "attach_volume" :: held 0.120s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f6589e87-a7c9-44c1-8b3b-edcfbdfb4582 tempest-VolumesActionsTest-2116014960 None] Acquiring lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5-detach_volume" by "detach_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:10 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f6589e87-a7c9-44c1-8b3b-edcfbdfb4582 tempest-VolumesActionsTest-2116014960 None] Lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:10 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f6589e87-a7c9-44c1-8b3b-edcfbdfb4582 tempest-VolumesActionsTest-2116014960 None] Detaching volume 1ef93aca-7c6c-4742-8409-9078301f05b5 from instance 3f7b1868-e411-4123-9f22-e6e0f6d84044. Apr 29 10:35:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea" returned: 0 in 1.156s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:10 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea is being set with open permissions: ugo+rw Apr 29 10:35:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:10 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea Apr 29 10:35:10 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:10 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f6589e87-a7c9-44c1-8b3b-edcfbdfb4582 tempest-VolumesActionsTest-2116014960 None] Detach volume completed successfully. Apr 29 10:35:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f6589e87-a7c9-44c1-8b3b-edcfbdfb4582 tempest-VolumesActionsTest-2116014960 None] Lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:11 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea" returned: 0 in 1.012s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:11 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-1544d60d-62ab-415d-9307-9d0d594a0fa5 tempest-SnapshotsActionsTest-806442688 None] Create snapshot completed successfully Apr 29 10:35:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-quobyte-c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Deleting offline snapshot c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea of volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:35:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] snapshot_file for this snap is: volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:35:12 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afe9ad6-0a66-43c8-af88-6ef2d26454c9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:12 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea Apr 29 10:35:12 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:13 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea" returned: 0 in 0.915s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:35:13 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f3fa1-96db-451b-a1db-490ca19f5a23]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:13 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:35:13 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:14 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 1.077s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:35:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:14 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea Apr 29 10:35:14 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:15 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea" returned: 0 in 0.985s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:15 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea Apr 29 10:35:15 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:16 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea" returned: 0 in 0.616s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea" released by "_delete_snapshot" :: held 3.753s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" released by "delete_snapshot" :: held 3.808s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=106,cinder:SELECT=108,cinder:DELETE=6,cinder:INSERT=24 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=82,cinder:INSERT=26,cinder:UPDATE=98,cinder:DELETE=9 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Created reservations ['762bfd5b-1d99-495c-90ff-fddda0f3b9cc', '0ceea845-726c-4638-a096-5955dea75fe3', 'f9fef9f7-c0b9-4cd5-983a-047dff3e60de', '0d083659-69db-49d1-a109-8bfe13ab82d0'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:35:16 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Delete snapshot completed successfully. Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-83436761-47e3-4e10-a84b-72b3f70a264e tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-c1357c4d-c5ce-4bf1-a241-7ef7fb3264ea-delete_snapshot" released by "delete_snapshot" :: held 4.039s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] Creating offline snapshot 09bb386b-bd19-4b03-8385-cab441bc98ce of volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b70c55-9fc7-4ef8-8175-d9cfe37083ad]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:17 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:35:17 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:18 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 1.067s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:35:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:18 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce 1G Apr 29 10:35:18 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:19 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce 1G" returned: 0 in 1.033s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:19 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce Apr 29 10:35:19 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:19 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce" returned: 0 in 0.804s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:19 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce is being set with open permissions: ugo+rw Apr 29 10:35:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:19 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce Apr 29 10:35:19 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:20 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce" returned: 0 in 0.725s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.797s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:20 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4cecad9e-287f-4cf3-b222-e2b882181566 tempest-SnapshotsActionsTest-806442688 None] Create snapshot completed successfully Apr 29 10:35:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eaa456-01c4-4f80-9dff-148cf8acf0af]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:20 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 Apr 29 10:35:20 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-09bb386b-bd19-4b03-8385-cab441bc98ce-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-09bb386b-bd19-4b03-8385-cab441bc98ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-quobyte-09bb386b-bd19-4b03-8385-cab441bc98ce" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-09bb386b-bd19-4b03-8385-cab441bc98ce" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Deleting offline snapshot 09bb386b-bd19-4b03-8385-cab441bc98ce of volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] snapshot_file for this snap is: volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4becfef0-bd3d-4824-8642-7b2d45394703]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:21 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce Apr 29 10:35:21 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:21 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5" returned: 0 in 0.969s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da22e3-1eca-4423-9937-e2ca2cd7b38f]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:21 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 Apr 29 10:35:21 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:22 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce" returned: 0 in 0.905s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:35:22 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a885a38e-5cdd-423d-a470-f0a04c4126f5]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:22 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:35:22 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:22 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5" returned: 0 in 0.944s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.77f62f73-0aaf-41c9-96dc-0396afdac2e2uuyub3q2.img {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:22 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.77f62f73-0aaf-41c9-96dc-0396afdac2e2uuyub3q2.img Apr 29 10:35:22 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:23 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 0.933s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:35:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:23 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce Apr 29 10:35:23 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:25 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce" returned: 0 in 1.983s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:25 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce Apr 29 10:35:25 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:26 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.09bb386b-bd19-4b03-8385-cab441bc98ce" returned: 0 in 1.455s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-09bb386b-bd19-4b03-8385-cab441bc98ce" released by "_delete_snapshot" :: held 5.505s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" released by "delete_snapshot" :: held 5.548s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:27 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Created reservations ['4cabd84a-f67a-4e44-adad-e1e8fde5f4d3', 'db6d31f6-dca9-4d86-855d-127c134da601', 'ee01db96-f81b-49b8-a75a-794b7b909cc8', '57ee1f51-b9fb-4143-8baf-981bc0800b40'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:35:27 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Delete snapshot completed successfully. Apr 29 10:35:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-cc96c77b-d3cf-4d9f-bcc8-732cb8e03822 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-09bb386b-bd19-4b03-8385-cab441bc98ce-delete_snapshot" released by "delete_snapshot" :: held 5.962s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:28 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.77f62f73-0aaf-41c9-96dc-0396afdac2e2uuyub3q2.img" returned: 0 in 6.024s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:28 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4311c861-c835-401e-8a90-93566a861bd1]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:28 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 Apr 29 10:35:28 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Flow 'volume_create_manager' (9aa49406-8891-4b6c-a8ba-d33239f94aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800ca849-7f85-4d0d-8b1c-9685f2ad997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800ca849-7f85-4d0d-8b1c-9685f2ad997c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-294934148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba74eaf-bddd-4d67-a508-669cb9dbcca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a38f8bfeed4697bd934140166428b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:35:29Z,use_quota=True,user_id='df09d71afef84e04bca11e1dbdb06f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df38a217-ac67-42cb-90fe-bf8195200a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df38a217-ac67-42cb-90fe-bf8195200a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dd0a09-c6ac-4acf-9749-64da6c9925bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.image.glance [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Creating Keystone auth plugin from conf {{(pid=83806) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dd0a09-c6ac-4acf-9749-64da6c9925bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fba74eaf-bddd-4d67-a508-669cb9dbcca6', 'volume_name': 'volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a56b0-1cba-413e-a32f-a05aa7efd452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a56b0-1cba-413e-a32f-a05aa7efd452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee7d024-0ed8-4e1e-989c-f9ecc33d7401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:29 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Volume fba74eaf-bddd-4d67-a508-669cb9dbcca6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Trying to clone fba74eaf-bddd-4d67-a508-669cb9dbcca6 from image 79b62ee8-86ba-4c65-a753-39d7d038c9fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]). {{(pid=83806) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 10:35:29 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5" returned: 0 in 0.990s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.77f62f73-0aaf-41c9-96dc-0396afdac2e2uuyub3q2.img {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:35:29 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Converted 1024.00 MB image at 169.97 MB/s Apr 29 10:35:29 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] 77f62f73-0aaf-41c9-96dc-0396afdac2e2 was raw, no need to convert to raw {{(pid=83806) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 10:35:30 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 10:35:30 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Image download 20.69 MB at 20.69 MB/s Apr 29 10:35:30 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[70064595-6ddf-4d9c-a6d0-4dd7650cc2ae]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:30 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD Apr 29 10:35:30 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:30 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD" returned: 0 in 0.700s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:30 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Temporary image 79b62ee8-86ba-4c65-a753-39d7d038c9fd is fetched for user df09d71afef84e04bca11e1dbdb06f93. {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 10:35:31 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[83215817-3b57-4b3f-b4d9-4e71f596ba7d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:31 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD Apr 29 10:35:31 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:31 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:35:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:35:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:35:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:33 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:35:33 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:33 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.627s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:35:41 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=10 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:35:41 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:INSERT=3,cinder:UPDATE=16,cinder:SELECT=11,cinder:DELETE=1 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (31dc3d73-f52e-4819-b13d-ec5a62ff3228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7010395-2ac6-4ca0-8a5d-28c29d127167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7010395-2ac6-4ca0-8a5d-28c29d127167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1448477683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50aa3e56-a4d0-4cbd-8ed4-d4924f5de885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:35:45Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194b54e5-b8c4-4d63-b922-be4d82d418cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194b54e5-b8c4-4d63-b922-be4d82d418cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d891979a-3144-42ae-a61c-97430384c8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d891979a-3144-42ae-a61c-97430384c8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50aa3e56-a4d0-4cbd-8ed4-d4924f5de885', 'volume_name': 'volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdc6a18-55a6-44a2-b165-2948a006fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdc6a18-55a6-44a2-b165-2948a006fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25212ea-d6b7-4b2d-a33c-ec9e7c8d8bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:45 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Volume 50aa3e56-a4d0-4cbd-8ed4-d4924f5de885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885', 'volume_size': 1} Apr 29 10:35:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.827s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Uploaded volume to glance image-id: 77f62f73-0aaf-41c9-96dc-0396afdac2e2. {{(pid=83806) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 10:35:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 21.901s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] Creating offline snapshot 2e895730-4ace-4ae3-bef8-d317e13c36a8 of volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:35:50 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5411475c-44ee-4f5c-b906-0c27f1788a44 tempest-VolumesActionsTest-2116014960 None] Copy volume to image completed successfully. Apr 29 10:35:50 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[c746be0f-10d2-49fc-b467-e076e7ce7fb1]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:50 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:35:50 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:51 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 0.716s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:35:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:51 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 1G Apr 29 10:35:51 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:52 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 1G" returned: 0 in 0.876s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:52 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 Apr 29 10:35:52 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:52 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8" returned: 0 in 0.672s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:52 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 is being set with open permissions: ugo+rw Apr 29 10:35:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:52 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 Apr 29 10:35:52 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:53 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8" returned: 0 in 0.655s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.870s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-294934148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba74eaf-bddd-4d67-a508-669cb9dbcca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a38f8bfeed4697bd934140166428b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:35:29Z,use_quota=True,user_id='df09d71afef84e04bca11e1dbdb06f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Creating volume fba74eaf-bddd-4d67-a508-669cb9dbcca6 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:35:53 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:35:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:53 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 1073741824 Apr 29 10:35:53 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:53 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-31af5328-86fe-4770-8b47-c12b2c0f9ea7 tempest-SnapshotsActionsTest-806442688 None] Create snapshot completed successfully Apr 29 10:35:54 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 1073741824" returned: 0 in 0.812s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:54 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 Apr 29 10:35:54 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-2e895730-4ace-4ae3-bef8-d317e13c36a8-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-2e895730-4ace-4ae3-bef8-d317e13c36a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-quobyte-2e895730-4ace-4ae3-bef8-d317e13c36a8" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-2e895730-4ace-4ae3-bef8-d317e13c36a8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Deleting offline snapshot 2e895730-4ace-4ae3-bef8-d317e13c36a8 of volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] snapshot_file for this snap is: volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaa37d6-614c-466c-96fc-3c247e5a4c51]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:55 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 Apr 29 10:35:55 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:55 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6" returned: 0 in 0.616s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.686s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1448477683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50aa3e56-a4d0-4cbd-8ed4-d4924f5de885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:35:45Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Creating volume 50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:35:55 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:55 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 1073741824 Apr 29 10:35:55 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Attempting download of 79b62ee8-86ba-4c65-a753-39d7d038c9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}])) to volume fba74eaf-bddd-4d67-a508-669cb9dbcca6. {{(pid=83806) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8606a4d-39ba-4f84-9fbc-ae4a27139179]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5g2lbzok {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:55 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5g2lbzok Apr 29 10:35:55 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:55 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8" returned: 0 in 0.735s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f395ed60-f3d0-4397-8869-6428f76d3f24]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:55 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:35:55 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:55 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 1073741824" returned: 0 in 0.834s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:56 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5g2lbzok" returned: 0 in 0.811s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5g2lbzok {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:56 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 Apr 29 10:35:56 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:56 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5g2lbzok Apr 29 10:35:56 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:56 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 0.818s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:56 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 Apr 29 10:35:56 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:56 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885" returned: 0 in 0.656s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.530s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25212ea-d6b7-4b2d-a33c-ec9e7c8d8bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19414b6-99cf-4771-b12e-57be3f9825fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eac1f8-94bf-41b8-afad-a63b337451f8]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:56 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5g2lbzok" returned: 1 in 0.690s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5g2lbzok' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7aabe9-b130-4c1b-8260-faec524edc7f]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:56 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Volume volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 (50aa3e56-a4d0-4cbd-8ed4-d4924f5de885): created successfully Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19414b6-99cf-4771-b12e-57be3f9825fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:35:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (31dc3d73-f52e-4819-b13d-ec5a62ff3228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:35:56 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b3aab937-bfb6-418f-b722-45d12911758a tempest-VolumesActionsTest-40164440 None] Created volume successfully. Apr 29 10:35:56 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 Apr 29 10:35:56 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:56 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD Apr 29 10:35:56 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-203d92fe-55ef-4627-9c19-36c2679c1d3b tempest-VolumesActionsTest-40164440 None] Acquiring lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885" by "attach_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-203d92fe-55ef-4627-9c19-36c2679c1d3b tempest-VolumesActionsTest-40164440 None] Lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885" acquired by "attach_volume" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:57 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-203d92fe-55ef-4627-9c19-36c2679c1d3b tempest-VolumesActionsTest-40164440 None] Attaching volume 50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 to instance 930e6ff7-1846-4a4c-8f1a-4648e9b4d1ac at mountpoint /dev/vdb on host None. Apr 29 10:35:57 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-203d92fe-55ef-4627-9c19-36c2679c1d3b tempest-VolumesActionsTest-40164440 None] Attach volume completed successfully. Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-203d92fe-55ef-4627-9c19-36c2679c1d3b tempest-VolumesActionsTest-40164440 None] Lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885" released by "attach_volume" :: held 0.121s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:57 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8" returned: 0 in 0.866s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:57 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8 Apr 29 10:35:57 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:57 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] 79b62ee8-86ba-4c65-a753-39d7d038c9fd was qcow2, converting to raw {{(pid=83806) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:57 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5" returned: 0 in 0.826s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:57 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 Apr 29 10:35:57 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[547a4c2c-b1c6-48b2-8495-d8cb74774d30]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:35:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:57 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 Apr 29 10:35:57 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:58 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.2e895730-4ace-4ae3-bef8-d317e13c36a8" returned: 0 in 0.669s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-2e895730-4ace-4ae3-bef8-d317e13c36a8" released by "_delete_snapshot" :: held 3.210s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" released by "delete_snapshot" :: held 3.239s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:58 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2cc82a3f-1e4e-4e54-a4d0-ad406615c4b6 tempest-VolumesActionsTest-1859689697 None] Terminate volume connection completed successfully. Apr 29 10:35:58 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Created reservations ['e9ec41b8-db01-4687-80ca-2fbb5bd1362e', 'fa111f64-8937-4570-a08b-e883c8e51346', '21208e52-b68f-478a-bb3f-10297b56da8a', '97504b5f-9732-4743-a492-63551b88d47c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:35:58 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Delete snapshot completed successfully. Apr 29 10:35:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-15546b69-50a8-440a-9b69-7a60229ed708 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-2e895730-4ace-4ae3-bef8-d317e13c36a8-delete_snapshot" released by "delete_snapshot" :: held 3.419s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:58 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 29 10:35:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5" returned: 0 in 0.818s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:35:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:35:58 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img Apr 29 10:35:58 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:35:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2cc82a3f-1e4e-4e54-a4d0-ad406615c4b6 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885-detach_volume" by "detach_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2cc82a3f-1e4e-4e54-a4d0-ad406615c4b6 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:58 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2cc82a3f-1e4e-4e54-a4d0-ad406615c4b6 tempest-VolumesActionsTest-1859689697 None] Detaching volume 50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 from instance 930e6ff7-1846-4a4c-8f1a-4648e9b4d1ac. Apr 29 10:35:58 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2cc82a3f-1e4e-4e54-a4d0-ad406615c4b6 tempest-VolumesActionsTest-1859689697 None] Detach volume completed successfully. Apr 29 10:35:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2cc82a3f-1e4e-4e54-a4d0-ad406615c4b6 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:35:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:35:59 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-06ba9b70-0c89-4c32-ad42-17d75e42f3de tempest-VolumesActionsTest-40164440 None] Acquiring lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885-detach_volume" by "detach_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:35:59 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-06ba9b70-0c89-4c32-ad42-17d75e42f3de tempest-VolumesActionsTest-40164440 None] Lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:35:59 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-06ba9b70-0c89-4c32-ad42-17d75e42f3de tempest-VolumesActionsTest-40164440 None] Volume detach called, but volume not attached. Apr 29 10:35:59 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-06ba9b70-0c89-4c32-ad42-17d75e42f3de tempest-VolumesActionsTest-40164440 None] Lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:00 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6" returned: 0 in 3.054s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:00 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_ua_440sxdevstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:36:00 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Converted 112.00 MB image at 36.66 MB/s Apr 29 10:36:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:00 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 1G Apr 29 10:36:00 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Acquiring lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Acquiring lock "cinder-quobyte-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Lock "cinder-quobyte-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885" acquired by "delete_volume" :: waited 0.081s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:01 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08cbf9c-dff5-4e17-bcf6-3721083c18fa]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:01 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 Apr 29 10:36:01 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:01 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 1G" returned: 0 in 1.295s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:02 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a883828-9581-49ae-bd7a-ed43fc682b2d]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:02 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 Apr 29 10:36:02 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:03 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885" returned: 0 in 2.587s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:03 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885 Apr 29 10:36:03 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:04 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6" returned: 0 in 2.129s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:04 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 Apr 29 10:36:04 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:04 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img" returned: 0 in 6.212s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:04 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[726fe7bd-de51-40d7-a644-1c5ca6929232]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:04 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 Apr 29 10:36:04 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:04 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885" returned: 0 in 1.100s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Lock "cinder-quobyte-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885" released by "delete_volume" :: held 3.799s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:04 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Created reservations ['e01469a6-ea7c-4064-bfb6-239cab15621c', 'c946d81c-9226-4802-ac29-45dfe6a64c47', 'faf76361-c8f9-4e86-a9d1-e75116f7bc59', '0dcbc089-131d-4b84-912e-3e2ecff3c876'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:05 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:05 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:05 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6" returned: 1 in 0.938s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Downloaded image 79b62ee8-86ba-4c65-a753-39d7d038c9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}])) to volume fba74eaf-bddd-4d67-a508-669cb9dbcca6 successfully. {{(pid=83806) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Temporary image 79b62ee8-86ba-4c65-a753-39d7d038c9fd for user df09d71afef84e04bca11e1dbdb06f93 is deleted. {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Marking volume fba74eaf-bddd-4d67-a508-669cb9dbcca6 as bootable. {{(pid=83806) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Copying metadata from image 79b62ee8-86ba-4c65-a753-39d7d038c9fd to fba74eaf-bddd-4d67-a508-669cb9dbcca6. {{(pid=83806) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Creating volume glance metadata for volume fba74eaf-bddd-4d67-a508-669cb9dbcca6 backed by image 79b62ee8-86ba-4c65-a753-39d7d038c9fd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83806) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee7d024-0ed8-4e1e-989c-f9ecc33d7401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6698d9ad-f574-4679-8233-13e3e8eed8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:05 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Volume volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 (fba74eaf-bddd-4d67-a508-669cb9dbcca6): created successfully Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6698d9ad-f574-4679-8233-13e3e8eed8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Flow 'volume_create_manager' (9aa49406-8891-4b6c-a8ba-d33239f94aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-59b82d38-a853-4280-ae5a-9766a3e97ffe tempest-VolumesImageMetadata-799510498 None] Created volume successfully. Apr 29 10:36:05 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5" returned: 0 in 0.929s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:36:05 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Converted 1024.00 MB image at 164.81 MB/s Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] 1647f16a-634a-4b14-8348-ba374d1ebe14 was raw, converting to qcow2 {{(pid=83806) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[672d5b45-3cbf-4474-a0cc-4b09ad6e1fae]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:05 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.698s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:05 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img Apr 29 10:36:05 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Deleted volume successfully. Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccf5bf61-cf74-4fc4-beac-699d0e8d54ff tempest-VolumesActionsTest-40164440 None] Lock "cinder-50aa3e56-a4d0-4cbd-8ed4-d4924f5de885-delete_volume" released by "delete_volume" :: held 4.933s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Acquiring lock "cinder-fba74eaf-bddd-4d67-a508-669cb9dbcca6-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Lock "cinder-fba74eaf-bddd-4d67-a508-669cb9dbcca6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Acquiring lock "cinder-quobyte-fba74eaf-bddd-4d67-a508-669cb9dbcca6" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Lock "cinder-quobyte-fba74eaf-bddd-4d67-a508-669cb9dbcca6" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:06 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edced36-ca77-41a7-94b4-2421e2808454]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:06 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 Apr 29 10:36:06 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:06 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img" returned: 0 in 0.821s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:06 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img Apr 29 10:36:06 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:06 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6" returned: 0 in 0.699s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:06 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 Apr 29 10:36:06 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:07 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img" returned: 1 in 0.947s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:36:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img /opt/stack/data/cinder/conversion/vol_upload_e76wyacl {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:07 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img /opt/stack/data/cinder/conversion/vol_upload_e76wyacl Apr 29 10:36:07 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:07 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6" returned: 1 in 0.975s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:36:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:07 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6 Apr 29 10:36:07 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:08 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img /opt/stack/data/cinder/conversion/vol_upload_e76wyacl" returned: 0 in 0.651s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Image conversion details: src /opt/stack/data/cinder/conversion/1ef93aca-7c6c-4742-8409-9078301f05b5.temp_image.1647f16a-634a-4b14-8348-ba374d1ebe14vb969xgb.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_e76wyacl {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:36:08 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7df3e2-904f-4e32-8ead-28c96c8b21a4]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e76wyacl {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:08 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e76wyacl Apr 29 10:36:08 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:08 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fba74eaf-bddd-4d67-a508-669cb9dbcca6" returned: 0 in 0.628s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Lock "cinder-quobyte-fba74eaf-bddd-4d67-a508-669cb9dbcca6" released by "delete_volume" :: held 2.376s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Created reservations ['9659662a-3f7f-4d48-a73d-4393703ca1e9', 'b7dd0449-780d-40e7-b166-2e929e825f4b', 'f1ba4c50-eb1b-4f7a-8818-f7e3bd54b165', '00e3ed8a-d01c-488c-9247-43af26f68a60'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:08 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:08 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:08 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e76wyacl" returned: 0 in 0.846s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:09 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.702s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:09 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:09 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Deleted volume successfully. Apr 29 10:36:09 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e936c80-1ce9-4684-b2e1-8b7bbc78170c tempest-VolumesImageMetadata-799510498 None] Lock "cinder-fba74eaf-bddd-4d67-a508-669cb9dbcca6-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.558s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Uploaded volume to glance image-id: 1647f16a-634a-4b14-8348-ba374d1ebe14. {{(pid=83806) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 10:36:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.461s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] Creating offline snapshot 6c589ae9-903f-4bb8-8c14-a3bfca23f71b of volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:36:10 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-689fb3e6-5e39-4c7d-b39c-1f3819b32220 tempest-VolumesActionsTest-2116014960 None] Copy volume to image completed successfully. Apr 29 10:36:10 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[727a1353-87f6-4c3b-9ae4-e385b30f0e43]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:10 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:36:10 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:11 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 0.781s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:36:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:11 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b 1G Apr 29 10:36:11 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Acquiring lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Acquiring lock "cinder-quobyte-1ef93aca-7c6c-4742-8409-9078301f05b5" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Lock "cinder-quobyte-1ef93aca-7c6c-4742-8409-9078301f05b5" acquired by "delete_volume" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:11 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[921a2a25-1aa8-448d-b25d-2d80db009015]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:12 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 Apr 29 10:36:12 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:12 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b 1G" returned: 0 in 1.007s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:12 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b Apr 29 10:36:12 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Flow 'volume_create_manager' (8f3c61db-7a7d-4a8b-8793-260683dbdada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37e18f2-aa61-4511-a25d-70f326068881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37e18f2-aa61-4511-a25d-70f326068881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1927588150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6d2f26-e9f1-442e-8837-8f44e2253868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0c10b8cb0b4a70a49e2ca5b6863b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:12Z,use_quota=True,user_id='6ca9a4f9097f456ba3a08817cfc057d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e873420-3241-4f84-b960-140092f16bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e873420-3241-4f84-b960-140092f16bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534bbdaf-8f43-4249-bf72-1b5f6becb75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534bbdaf-8f43-4249-bf72-1b5f6becb75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d6d2f26-e9f1-442e-8837-8f44e2253868', 'volume_name': 'volume-5d6d2f26-e9f1-442e-8837-8f44e2253868', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60a4055-8fa9-443b-ae98-c31a6b5bc27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60a4055-8fa9-443b-ae98-c31a6b5bc27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0bbe1f-5415-4300-b821-9e0959076e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:12 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Volume 5d6d2f26-e9f1-442e-8837-8f44e2253868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d6d2f26-e9f1-442e-8837-8f44e2253868', 'volume_size': 1} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:12 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5" returned: 0 in 0.882s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:12 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5 Apr 29 10:36:12 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (1519a5cb-ddd3-47ea-8c4c-eacfcccf1451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0635f6c-cbb3-414c-b787-141c1ad71ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0635f6c-cbb3-414c-b787-141c1ad71ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-651928232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:13Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f7058e-e294-4847-972c-29c839315cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f7058e-e294-4847-972c-29c839315cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3495db9c-1de7-44f8-8f43-f3464613cb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3495db9c-1de7-44f8-8f43-f3464613cb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b', 'volume_name': 'volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6df9ab1-23b9-496a-a320-dd7f9d038520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:13 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6df9ab1-23b9-496a-a320-dd7f9d038520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f465ec6c-42a2-4610-89ad-db8b9fdd81cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:13 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Volume 03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b', 'volume_size': 1} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b" returned: 0 in 0.919s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:13 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b is being set with open permissions: ugo+rw Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:13 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b Apr 29 10:36:13 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:13 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1ef93aca-7c6c-4742-8409-9078301f05b5" returned: 0 in 0.595s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Lock "cinder-quobyte-1ef93aca-7c6c-4742-8409-9078301f05b5" released by "delete_volume" :: held 1.531s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Created reservations ['1d52c199-b296-4d6b-a5c6-964a1a5363e6', 'af7e6e53-3c85-47a1-ba3a-34ca6e3513fe', 'd8eb2922-81d7-498c-80a2-ae0cb566bb8d', 'b36d20dc-12f0-42ea-ad27-070c4a6a7461'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:13 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:13 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:13 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b" returned: 0 in 0.602s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.441s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.042s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1927588150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6d2f26-e9f1-442e-8837-8f44e2253868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0c10b8cb0b4a70a49e2ca5b6863b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:12Z,use_quota=True,user_id='6ca9a4f9097f456ba3a08817cfc057d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Creating volume 5d6d2f26-e9f1-442e-8837-8f44e2253868 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:13 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:13 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868 1073741824 Apr 29 10:36:13 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:13 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f876a4a4-311b-4a37-94d9-006d6d81dc40 tempest-SnapshotsActionsTest-806442688 None] Create snapshot completed successfully Apr 29 10:36:14 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.617s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:14 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Deleted volume successfully. Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7ae7c972-0661-4780-9b90-85b14fb581e2 tempest-VolumesActionsTest-2116014960 None] Lock "cinder-1ef93aca-7c6c-4742-8409-9078301f05b5-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:14 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868 1073741824" returned: 0 in 0.784s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:14 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868 Apr 29 10:36:14 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-6c589ae9-903f-4bb8-8c14-a3bfca23f71b-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-6c589ae9-903f-4bb8-8c14-a3bfca23f71b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Acquiring lock "cinder-quobyte-6c589ae9-903f-4bb8-8c14-a3bfca23f71b" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-6c589ae9-903f-4bb8-8c14-a3bfca23f71b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Deleting offline snapshot 6c589ae9-903f-4bb8-8c14-a3bfca23f71b of volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] snapshot_file for this snap is: volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ffe2aa-f202-4785-8948-5dd7a3f5ecae]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:15 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b Apr 29 10:36:15 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:15 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868" returned: 0 in 0.715s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.188s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-651928232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:13Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Creating volume 03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:15 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0bbe1f-5415-4300-b821-9e0959076e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d6d2f26-e9f1-442e-8837-8f44e2253868', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f84cc35-8e70-4ab7-92e0-65e7c0ae041a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:15 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b 1073741824 Apr 29 10:36:15 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:15 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Volume volume-5d6d2f26-e9f1-442e-8837-8f44e2253868 (5d6d2f26-e9f1-442e-8837-8f44e2253868): created successfully Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f84cc35-8e70-4ab7-92e0-65e7c0ae041a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Flow 'volume_create_manager' (8f3c61db-7a7d-4a8b-8793-260683dbdada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:15 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-049ac14c-0e20-4ecd-8f04-f06687083b5e tempest-VolumesMetadataTest-2010522226 None] Created volume successfully. Apr 29 10:36:15 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b" returned: 0 in 0.756s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c0e653-f3ef-450f-9096-86ed7b4653b3]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:15 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:36:15 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:16 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b 1073741824" returned: 0 in 0.991s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:16 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b Apr 29 10:36:16 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Acquiring lock "cinder-5d6d2f26-e9f1-442e-8837-8f44e2253868-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Lock "cinder-5d6d2f26-e9f1-442e-8837-8f44e2253868-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Acquiring lock "cinder-quobyte-5d6d2f26-e9f1-442e-8837-8f44e2253868" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Lock "cinder-quobyte-5d6d2f26-e9f1-442e-8837-8f44e2253868" acquired by "delete_volume" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:16 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 0.993s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb83d0f-e273-48c8-8b62-cb3c0c54ad27]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:16 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b Apr 29 10:36:16 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:16 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868 Apr 29 10:36:16 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:17 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b" returned: 0 in 0.841s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f465ec6c-42a2-4610-89ad-db8b9fdd81cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10db9569-cb88-43fb-bc4e-c4bac1d2fd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:17 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Volume volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b (03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b): created successfully Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10db9569-cb88-43fb-bc4e-c4bac1d2fd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (1519a5cb-ddd3-47ea-8c4c-eacfcccf1451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:17 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7cdfb662-4e3d-4710-a175-62779f009b9f tempest-VolumesActionsTest-40164440 None] Created volume successfully. Apr 29 10:36:17 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b" returned: 0 in 0.888s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:17 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868" returned: 0 in 0.898s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:17 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b Apr 29 10:36:17 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:17 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868 Apr 29 10:36:17 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:18 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.6c589ae9-903f-4bb8-8c14-a3bfca23f71b" returned: 0 in 0.732s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:18 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5d6d2f26-e9f1-442e-8837-8f44e2253868" returned: 0 in 0.736s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-6c589ae9-903f-4bb8-8c14-a3bfca23f71b" released by "_delete_snapshot" :: held 3.516s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Lock "cinder-quobyte-5d6d2f26-e9f1-442e-8837-8f44e2253868" released by "delete_volume" :: held 1.697s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" released by "delete_snapshot" :: held 3.564s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Created reservations ['405d5e02-d0bb-4989-9d4f-feb5e214c304', '899d59b1-b6b6-4308-a335-69f7fa16c8aa', 'a91c3ad7-cff7-4b58-87b3-19ae271940cc', '761ad163-335e-4792-86d7-2a3c18ac4f3a'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Created reservations ['8def304f-0a19-4f32-be4d-74fc9dda2892', '31ca6c7b-08d2-464f-927b-de12c09e526b', '2fcb3379-8070-40be-8b3e-e8cee56e0a56', '302a9207-a8c5-49b6-a320-7f6cd41be778'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "cinder-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:18 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:18 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:18 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Delete snapshot completed successfully. Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "cinder-quobyte-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4c6b970a-a313-4ca8-ad8e-408325aae869 tempest-SnapshotsActionsTest-790643086 None] Lock "cinder-6c589ae9-903f-4bb8-8c14-a3bfca23f71b-delete_snapshot" released by "delete_snapshot" :: held 3.892s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-quobyte-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd82e09-c984-44f2-bd1b-959bae2ed33d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:18 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b Apr 29 10:36:18 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:19 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.724s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Deleted volume successfully. Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7d0b5b0-4760-4d2f-ba52-0f20b3da92d8 tempest-VolumesMetadataTest-2010522226 None] Lock "cinder-5d6d2f26-e9f1-442e-8837-8f44e2253868-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "cinder-49c96b8b-dbab-47c4-806c-1947f1a7b65b-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Lock "cinder-49c96b8b-dbab-47c4-806c-1947f1a7b65b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "cinder-quobyte-49c96b8b-dbab-47c4-806c-1947f1a7b65b" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Lock "cinder-quobyte-49c96b8b-dbab-47c4-806c-1947f1a7b65b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Deleting offline snapshot 49c96b8b-dbab-47c4-806c-1947f1a7b65b of volume 4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] snapshot_file for this snap is: volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[2173575e-41d2-48d1-949a-2a77a270ca6f]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:19 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:36:19 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:19 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b" returned: 0 in 1.098s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:19 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b Apr 29 10:36:19 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:20 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b" returned: 0 in 0.702s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-quobyte-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b" released by "delete_volume" :: held 1.869s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:20 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 0.970s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d42fe1a-55ae-4574-8417-75ae085e8ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Created reservations ['5f482bb8-8a37-44ac-aa5f-69a92b53b5dc', '7bfbe4da-b93c-4d9a-b335-e2ff53aec224', '713643c6-c9a3-4551-905a-f857b602334d', 'bf074385-3fb3-4584-91df-d1bc5269a59b'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da0ec14-782c-4726-959e-ab6f47110c01]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (3762e1bb-2091-4873-87ba-faba4ba1d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dde50bf-c83c-4398-87f0-be2d2c676bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:20 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead Apr 29 10:36:20 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:20 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:20 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dde50bf-c83c-4398-87f0-be2d2c676bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1623621039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4919af9-dd06-4c3a-81db-4bf3b775e7e8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:21Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da977f48-1661-48e7-a216-5fd781086a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da977f48-1661-48e7-a216-5fd781086a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4706fa99-3c78-49b9-8f2c-28d2f9803505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4706fa99-3c78-49b9-8f2c-28d2f9803505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4919af9-dd06-4c3a-81db-4bf3b775e7e8', 'volume_name': 'volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022d5819-9937-43c2-888e-924ca82e430d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022d5819-9937-43c2-888e-924ca82e430d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6890c887-da20-4abf-a542-8a084bc61017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:20 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Volume d4919af9-dd06-4c3a-81db-4bf3b775e7e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8', 'volume_size': 1} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1623621039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4919af9-dd06-4c3a-81db-4bf3b775e7e8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:21Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Creating volume d4919af9-dd06-4c3a-81db-4bf3b775e7e8 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:21 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:21 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8 1073741824 Apr 29 10:36:21 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (871d0a43-306a-4a71-8def-f2b40b62f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c814c551-73b4-429c-9e9c-e9ab82874758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c814c551-73b4-429c-9e9c-e9ab82874758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1802003477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db573cb2-0982-4b27-8016-dec5fe491e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:21Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e47535-4e45-4930-8afa-558dcea1ce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e47535-4e45-4930-8afa-558dcea1ce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42df4735-a009-4b5a-b081-7111b52a05e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42df4735-a009-4b5a-b081-7111b52a05e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db573cb2-0982-4b27-8016-dec5fe491e4c', 'volume_name': 'volume-db573cb2-0982-4b27-8016-dec5fe491e4c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150c4c11-ed84-4496-8388-3104a9f1782d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150c4c11-ed84-4496-8388-3104a9f1782d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f6c485-2054-4800-97d5-0cd1a4701b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:21 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Volume db573cb2-0982-4b27-8016-dec5fe491e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db573cb2-0982-4b27-8016-dec5fe491e4c', 'volume_size': 1} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:21 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead" returned: 0 in 1.052s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:21 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:36:21 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:21 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.998s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:21 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Deleted volume successfully. Apr 29 10:36:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c58e4cde-9f75-431c-955d-7ffae76640b0 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-03b2ba8c-0ddd-47de-a8c6-75c81aa59b1b-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:22 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8 1073741824" returned: 0 in 1.066s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:22 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8 Apr 29 10:36:22 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:22 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 0.775s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:22 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b Apr 29 10:36:22 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Flow 'volume_create_manager' (c2ad1e9a-d33a-451e-bd63-cf7f090fb692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc6df9f-ed88-4431-9c2d-fd932336cc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc6df9f-ed88-4431-9c2d-fd932336cc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2117404499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b1bb46-3817-4ec3-a4dc-73fa65106d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5570fef5e44bf4a23db2be06c097bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:23Z,use_quota=True,user_id='0954a56319f34670a083324bd3209993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2917eec9-0c98-452e-9deb-4b4093a9f61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2917eec9-0c98-452e-9deb-4b4093a9f61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5ff03c-6841-43f9-90f5-661b96210ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5ff03c-6841-43f9-90f5-661b96210ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b1bb46-3817-4ec3-a4dc-73fa65106d7b', 'volume_name': 'volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d0a806-b0be-45ef-8bf6-2db6f82cc8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d0a806-b0be-45ef-8bf6-2db6f82cc8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d4407e-8087-49fa-bacf-192f4f13ace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:22 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Volume d4b1bb46-3817-4ec3-a4dc-73fa65106d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b', 'volume_size': 1} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:22 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8" returned: 0 in 0.669s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.078s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1802003477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db573cb2-0982-4b27-8016-dec5fe491e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:21Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Creating volume db573cb2-0982-4b27-8016-dec5fe491e4c {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:22 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6890c887-da20-4abf-a542-8a084bc61017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d977b88-5742-4b1b-8072-46cdf0a6d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:22 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c 1073741824 Apr 29 10:36:22 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:22 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Volume volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8 (d4919af9-dd06-4c3a-81db-4bf3b775e7e8): created successfully Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d977b88-5742-4b1b-8072-46cdf0a6d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (3762e1bb-2091-4873-87ba-faba4ba1d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:22 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-22e55cf1-c529-40c9-998b-938ceb904e9e tempest-VolumesGetTest-1234097105 None] Created volume successfully. Apr 29 10:36:23 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead.49c96b8b-dbab-47c4-806c-1947f1a7b65b" returned: 0 in 0.641s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Lock "cinder-quobyte-49c96b8b-dbab-47c4-806c-1947f1a7b65b" released by "_delete_snapshot" :: held 3.603s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" released by "delete_snapshot" :: held 3.635s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Created reservations ['3460be86-943d-4c6a-af94-21a76007075f', '022a2a9f-0f06-40cf-97a7-06758c00bd70', 'e3fd2d2e-5ef7-4ed1-a890-727d83ea822a', '6042652f-2992-488c-ab83-fae1e0221550'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Delete snapshot completed successfully. Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-30b21973-a598-4572-9b1c-a7597bded99f tempest-SnapshotsActionsTest-806442688 None] Lock "cinder-49c96b8b-dbab-47c4-806c-1947f1a7b65b-delete_snapshot" released by "delete_snapshot" :: held 3.843s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:23 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c 1073741824" returned: 0 in 0.847s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:23 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c Apr 29 10:36:23 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "cinder-4d42fe1a-55ae-4574-8417-75ae085e8ead-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Lock "cinder-4d42fe1a-55ae-4574-8417-75ae085e8ead-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29ba6a4-c86d-490d-bb52-e21c2118f60f]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:24 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead Apr 29 10:36:24 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:24 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c" returned: 0 in 0.676s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2117404499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b1bb46-3817-4ec3-a4dc-73fa65106d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5570fef5e44bf4a23db2be06c097bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:23Z,use_quota=True,user_id='0954a56319f34670a083324bd3209993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Creating volume d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:24 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f6c485-2054-4800-97d5-0cd1a4701b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db573cb2-0982-4b27-8016-dec5fe491e4c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:24 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b 1073741824 Apr 29 10:36:24 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3d2f79-4396-49a8-b674-c190a856ef73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:24 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Volume volume-db573cb2-0982-4b27-8016-dec5fe491e4c (db573cb2-0982-4b27-8016-dec5fe491e4c): created successfully Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3d2f79-4396-49a8-b674-c190a856ef73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (871d0a43-306a-4a71-8def-f2b40b62f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:24 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2cbeb77f-65e6-4743-b182-2f199daade20 tempest-VolumesActionsTest-40164440 None] Created volume successfully. Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (165192fe-6e17-40a6-bb7e-24fa506f5555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12142c44-63df-4fb6-a5a7-128b8306985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:24 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12142c44-63df-4fb6-a5a7-128b8306985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-84507365',display_name='tempest-VolumesGetTest-Volume-1425997013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d173c835-6151-41ef-a32c-025ac7cbe632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:25Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c771bcbc-9ebf-4387-9e91-87a59a65cf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c771bcbc-9ebf-4387-9e91-87a59a65cf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191f7444-3e1d-4686-9fe0-1e1333e8b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191f7444-3e1d-4686-9fe0-1e1333e8b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd173c835-6151-41ef-a32c-025ac7cbe632', 'volume_name': 'volume-d173c835-6151-41ef-a32c-025ac7cbe632', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb4f5e2-29c5-40eb-b34d-ab732843f20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb4f5e2-29c5-40eb-b34d-ab732843f20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3bb3da8-fe5e-4002-ad85-5e1ab3699344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:24 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Volume d173c835-6151-41ef-a32c-025ac7cbe632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d173c835-6151-41ef-a32c-025ac7cbe632', 'volume_size': 1} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead" returned: 0 in 0.921s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:24 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead Apr 29 10:36:24 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "cinder-db573cb2-0982-4b27-8016-dec5fe491e4c-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-db573cb2-0982-4b27-8016-dec5fe491e4c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "cinder-quobyte-db573cb2-0982-4b27-8016-dec5fe491e4c" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-quobyte-db573cb2-0982-4b27-8016-dec5fe491e4c" acquired by "delete_volume" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b9a887-90d3-4e1b-83e9-1c3d0ecef654]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:25 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c Apr 29 10:36:25 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:25 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b 1073741824" returned: 0 in 0.971s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:25 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b Apr 29 10:36:25 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:25 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4d42fe1a-55ae-4574-8417-75ae085e8ead" returned: 0 in 0.732s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Lock "cinder-quobyte-4d42fe1a-55ae-4574-8417-75ae085e8ead" released by "delete_volume" :: held 1.726s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Created reservations ['5d9db9ac-e700-4d52-aa0c-a1a404b9d309', 'd718e250-966a-43d9-82f9-a47a832c1e75', '2f464685-9ae3-4d79-ba1f-94e23279e667', 'c59e190b-f104-4414-b86a-736d910b2745'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:25 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:25 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:25 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c" returned: 0 in 0.830s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:25 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c Apr 29 10:36:25 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:26 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b" returned: 0 in 0.647s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.099s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-84507365',display_name='tempest-VolumesGetTest-Volume-1425997013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d173c835-6151-41ef-a32c-025ac7cbe632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:25Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Creating volume d173c835-6151-41ef-a32c-025ac7cbe632 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:26 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:26 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632 1073741824 Apr 29 10:36:26 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d4407e-8087-49fa-bacf-192f4f13ace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad40bcb-1f2f-4c79-8747-5d81556f28f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:26 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Volume volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b (d4b1bb46-3817-4ec3-a4dc-73fa65106d7b): created successfully Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad40bcb-1f2f-4c79-8747-5d81556f28f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Flow 'volume_create_manager' (c2ad1e9a-d33a-451e-bd63-cf7f090fb692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:26 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b91a7f40-cfac-49c7-983c-50e5c2392b54 tempest-VolumesCloneTest-1459226055 None] Created volume successfully. Apr 29 10:36:26 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:26 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.756s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:26 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Deleted volume successfully. Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-db573cb2-0982-4b27-8016-dec5fe491e4c" returned: 0 in 0.713s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-quobyte-db573cb2-0982-4b27-8016-dec5fe491e4c" released by "delete_volume" :: held 1.591s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b0b47662-b01a-421c-8293-95f08539d052 tempest-SnapshotsActionsTest-806442688 None] Lock "cinder-4d42fe1a-55ae-4574-8417-75ae085e8ead-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Created reservations ['956c17fd-54d8-4832-940e-522a1078e09d', '6cd841c9-69e7-4c64-9ce0-7a8f5491a305', 'c7502a48-6bf8-43b7-8dc9-d4037c447b6c', '9a143abd-e029-415f-a19d-7ac72be370e3'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:26 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:26 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:27 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632 1073741824" returned: 0 in 1.062s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:27 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632 Apr 29 10:36:27 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:27 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.979s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:27 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Deleted volume successfully. Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f448615e-7b66-4dbf-b51f-6c855302f9e1 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-db573cb2-0982-4b27-8016-dec5fe491e4c-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Flow 'volume_create_manager' (a1266102-59cb-474c-86e6-3f946f62216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f212c9a5-3e27-4871-8230-fa8af273f33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (6f3eaa18-2dad-4ed2-be84-ccd4a065bfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb5ddb0-9075-4919-b223-f41a95630636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f212c9a5-3e27-4871-8230-fa8af273f33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1616829108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563ccbbe-bd25-447a-b6de-f9ad53846722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5570fef5e44bf4a23db2be06c097bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d4b1bb46-3817-4ec3-a4dc-73fa65106d7b,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:28Z,use_quota=True,user_id='0954a56319f34670a083324bd3209993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c75239e-7309-4ed3-add1-345226a5f870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c75239e-7309-4ed3-add1-345226a5f870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6089946-4dfc-45ec-bb40-9d68f60d3856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb5ddb0-9075-4919-b223-f41a95630636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1433335112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ef5be3-8134-4cf4-a902-3a8bebac9f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:28Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e91c01f-07b4-49c4-966a-c6dc223be8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e91c01f-07b4-49c4-966a-c6dc223be8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52632e0-3e7d-45a2-9b19-af15807ca98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52632e0-3e7d-45a2-9b19-af15807ca98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ef5be3-8134-4cf4-a902-3a8bebac9f77', 'volume_name': 'volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd5768c-e155-4d15-92b8-f9e81701c327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd5768c-e155-4d15-92b8-f9e81701c327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a74c32-9305-48e1-83a6-23162c0e36e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:28 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Volume b4ef5be3-8134-4cf4-a902-3a8bebac9f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77', 'volume_size': 1} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6089946-4dfc-45ec-bb40-9d68f60d3856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '563ccbbe-bd25-447a-b6de-f9ad53846722', 'volume_name': 'volume-563ccbbe-bd25-447a-b6de-f9ad53846722', 'volume_size': 2, 'source_volid': 'd4b1bb46-3817-4ec3-a4dc-73fa65106d7b', 'source_volstatus': 'available'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724cc98e-328a-4472-85f9-f4eec1361bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724cc98e-328a-4472-85f9-f4eec1361bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0379b035-a378-429b-9891-f4b4b7a6f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:28 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Volume 563ccbbe-bd25-447a-b6de-f9ad53846722: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-563ccbbe-bd25-447a-b6de-f9ad53846722', 'volume_size': 2, 'source_volid': 'd4b1bb46-3817-4ec3-a4dc-73fa65106d7b', 'source_volstatus': 'available'} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:28 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632" returned: 0 in 0.928s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1433335112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ef5be3-8134-4cf4-a902-3a8bebac9f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:28Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Creating volume b4ef5be3-8134-4cf4-a902-3a8bebac9f77 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:28 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:28 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77 1073741824 Apr 29 10:36:28 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3bb3da8-fe5e-4002-ad85-5e1ab3699344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d173c835-6151-41ef-a32c-025ac7cbe632', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966bf52f-bc53-4fb6-92c2-263f9d850685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:28 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Volume volume-d173c835-6151-41ef-a32c-025ac7cbe632 (d173c835-6151-41ef-a32c-025ac7cbe632): created successfully Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966bf52f-bc53-4fb6-92c2-263f9d850685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (165192fe-6e17-40a6-bb7e-24fa506f5555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:28 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-da5cc68e-90c4-4c38-87fd-aa8e5f016529 tempest-VolumesGetTest-1234097105 None] Created volume successfully. Apr 29 10:36:28 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77 1073741824" returned: 0 in 0.856s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:29 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77 Apr 29 10:36:29 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-d173c835-6151-41ef-a32c-025ac7cbe632-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Lock "cinder-d173c835-6151-41ef-a32c-025ac7cbe632-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-quobyte-d173c835-6151-41ef-a32c-025ac7cbe632" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-d173c835-6151-41ef-a32c-025ac7cbe632" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0134de3-63d4-499e-a165-cd216d937a36]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:29 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632 Apr 29 10:36:29 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:29 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77" returned: 0 in 0.680s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.617s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:29 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Cloning volume d4b1bb46-3817-4ec3-a4dc-73fa65106d7b to volume 563ccbbe-bd25-447a-b6de-f9ad53846722 Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a74c32-9305-48e1-83a6-23162c0e36e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc72315-6e94-46c8-8822-c7651df3fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:29 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Volume volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77 (b4ef5be3-8134-4cf4-a902-3a8bebac9f77): created successfully Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc72315-6e94-46c8-8822-c7651df3fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (6f3eaa18-2dad-4ed2-be84-ccd4a065bfb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Creating offline snapshot 0a88b65a-cbec-41e0-9af9-17f46dc4bda2 of volume d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:36:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b2154aeb-19be-4d00-aafe-f246366bd8c8 tempest-VolumesActionsTest-40164440 None] Created volume successfully. Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[84124a89-4e5e-44f2-b13b-7f589d32dad7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:29 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b Apr 29 10:36:29 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "cinder-b4ef5be3-8134-4cf4-a902-3a8bebac9f77-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-b4ef5be3-8134-4cf4-a902-3a8bebac9f77-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "cinder-quobyte-b4ef5be3-8134-4cf4-a902-3a8bebac9f77" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-quobyte-b4ef5be3-8134-4cf4-a902-3a8bebac9f77" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:30 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e6601f-b6e1-46bd-835c-e03cb9919da9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:30 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632" returned: 0 in 0.877s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:30 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632 Apr 29 10:36:30 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:30 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77 Apr 29 10:36:30 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:30 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b" returned: 0 in 0.906s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:30 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 1G Apr 29 10:36:30 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:31 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d173c835-6151-41ef-a32c-025ac7cbe632" returned: 0 in 0.711s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-d173c835-6151-41ef-a32c-025ac7cbe632" released by "delete_volume" :: held 1.639s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:31 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77" returned: 0 in 0.849s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:31 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77 Apr 29 10:36:31 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Created reservations ['b9288b48-3873-4a1c-8f8c-e4e452e24b54', 'd3071bb9-0d2e-43b2-973f-d89f55ef3df7', 'ce15b28a-0993-4801-97a6-2533b0440e52', '3a6b380f-bbb4-4511-ae4f-fab36f15f4fb'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:31 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:31 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:31 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 1G" returned: 0 in 0.979s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:31 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 Apr 29 10:36:31 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-d4919af9-dd06-4c3a-81db-4bf3b775e7e8-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Lock "cinder-d4919af9-dd06-4c3a-81db-4bf3b775e7e8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-quobyte-d4919af9-dd06-4c3a-81db-4bf3b775e7e8" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-d4919af9-dd06-4c3a-81db-4bf3b775e7e8" acquired by "delete_volume" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bfe1c0-bb41-496b-a275-692fd552f70d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:32 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8 Apr 29 10:36:32 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:32 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b4ef5be3-8134-4cf4-a902-3a8bebac9f77" returned: 0 in 0.969s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:32 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-quobyte-b4ef5be3-8134-4cf4-a902-3a8bebac9f77" released by "delete_volume" :: held 1.872s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.839s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:32 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Deleted volume successfully. Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4568fe15-2d50-4ba5-add4-c1887c2e77c5 tempest-VolumesGetTest-1234097105 None] Lock "cinder-d173c835-6151-41ef-a32c-025ac7cbe632-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Created reservations ['eccb5f55-9363-4d56-92f9-25ae174efe26', 'a5f87bfa-594d-404d-abd3-4cbf9afa8abf', '6a62cfd3-ad3f-4359-a284-b3d745164f15', '79626d13-ddd7-4f3c-8f1d-c0a19f35201b'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:32 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:32 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:32 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2" returned: 0 in 0.905s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:32 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 is being set with open permissions: ugo+rw Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:32 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 Apr 29 10:36:32 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:32 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8" returned: 0 in 1.079s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:33 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8 Apr 29 10:36:33 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:33 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.812s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:33 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Deleted volume successfully. Apr 29 10:36:33 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:33 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f6d1106f-072b-4851-8613-97a909439397 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-b4ef5be3-8134-4cf4-a902-3a8bebac9f77-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (bd818d15-f6a5-42bd-b97b-0a7ae82fd155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5a5cfb-1d82-47a4-b3aa-4974ac3f71b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5a5cfb-1d82-47a4-b3aa-4974ac3f71b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-135651116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf49031c-ab2b-4893-8072-4595e348fb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:33Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacca42b-2ac4-4dbc-80df-ef6d634aa1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dacca42b-2ac4-4dbc-80df-ef6d634aa1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3704984-7494-42ab-bd91-953251debc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3704984-7494-42ab-bd91-953251debc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf49031c-ab2b-4893-8072-4595e348fb9b', 'volume_name': 'volume-bf49031c-ab2b-4893-8072-4595e348fb9b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fb2cc7-f813-4e99-ba68-a314dd537d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fb2cc7-f813-4e99-ba68-a314dd537d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862d85f0-e32d-4a69-96b2-942103ca3b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:33 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Volume bf49031c-ab2b-4893-8072-4595e348fb9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf49031c-ab2b-4893-8072-4595e348fb9b', 'volume_size': 1} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:33 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2" returned: 0 in 0.951s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:33 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.info Apr 29 10:36:33 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:33 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4919af9-dd06-4c3a-81db-4bf3b775e7e8" returned: 0 in 0.908s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-d4919af9-dd06-4c3a-81db-4bf3b775e7e8" released by "delete_volume" :: held 2.057s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:33 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.865s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:33 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Created reservations ['ce8daed1-8c08-4079-9131-233bd3e0131a', '28991b16-db77-4840-be69-089df1059be8', '9f6e158b-bb8f-4f1e-9ae3-1b1c628fbd54', '23a84feb-1afd-4d87-b958-eb320f1bed3b'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:34 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:34 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:34 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.info" returned: 0 in 0.779s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:34 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.info is being set with open permissions: ugo+rw Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:34 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.info Apr 29 10:36:34 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:34 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.699s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:34 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Deleted volume successfully. Apr 29 10:36:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8b42152f-7edd-44d5-ad09-ee377597f420 tempest-VolumesGetTest-1234097105 None] Lock "cinder-d4919af9-dd06-4c3a-81db-4bf3b775e7e8-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:35 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.info" returned: 0 in 0.673s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Acquiring lock "cinder-quobyte-563ccbbe-bd25-447a-b6de-f9ad53846722" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Lock "cinder-quobyte-563ccbbe-bd25-447a-b6de-f9ad53846722" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] snapshot: 0a88b65a-cbec-41e0-9af9-17f46dc4bda2, volume: 563ccbbe-bd25-447a-b6de-f9ad53846722, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d275691-c144-460b-a56f-69332808c603]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:35 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 Apr 29 10:36:35 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (f03dcd9d-470f-429b-a7a7-3ba5518b36f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5dfc42-3cd9-4643-8e25-e3671f8ca617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5dfc42-3cd9-4643-8e25-e3671f8ca617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-895346614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ded16f4-76cf-4a10-86b4-8d1d85522e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:36Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5cdae9-0387-42d6-ab3f-974aed521dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5cdae9-0387-42d6-ab3f-974aed521dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4af9c3-8e9f-49d1-91ed-8edc1f15abc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4af9c3-8e9f-49d1-91ed-8edc1f15abc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ded16f4-76cf-4a10-86b4-8d1d85522e37', 'volume_name': 'volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16382ca6-9142-4fe0-b3cf-b399bb23addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16382ca6-9142-4fe0-b3cf-b399bb23addc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd605d15-c24b-4961-876d-fe31e41855f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:35 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Volume 9ded16f4-76cf-4a10-86b4-8d1d85522e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37', 'volume_size': 1} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:35 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2" returned: 0 in 0.809s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cce283-e60e-4b54-9ad2-8b0d6db71de1]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:36 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b Apr 29 10:36:36 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:36 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b" returned: 0 in 0.746s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:36 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:36:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:36 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 Apr 29 10:36:36 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:42 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722" returned: 0 in 5.341s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=118,cinder:UPDATE=135,cinder:INSERT=32,cinder:DELETE=12 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e2781f-8e4e-4064-9349-3d737e04f362]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=131,cinder:SELECT=100,cinder:DELETE=9,cinder:INSERT=45 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Flow 'volume_create_manager' (21ddb74c-b11a-4bbf-8c62-46f4c8eb7f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a686bd8-6683-455e-94af-7790819cc2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a686bd8-6683-455e-94af-7790819cc2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1818423803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809f657b-a3aa-422e-944c-44f4692771b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae455d60eb649559754c34ef62e8e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:42Z,use_quota=True,user_id='0a924ffaefbf48a9ae68bc5509a165af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c28df3-37b4-4039-8cc4-70b50b9773c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c28df3-37b4-4039-8cc4-70b50b9773c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68560f59-c399-405a-9e80-b7bc5c6d6489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68560f59-c399-405a-9e80-b7bc5c6d6489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '809f657b-a3aa-422e-944c-44f4692771b9', 'volume_name': 'volume-809f657b-a3aa-422e-944c-44f4692771b9', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3615ae0-eab4-4dc8-af85-fb788cd4edb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3615ae0-eab4-4dc8-af85-fb788cd4edb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:42 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b Apr 29 10:36:42 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1943d8ec-532a-4820-b5a0-11b82ff538eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:42 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Volume 809f657b-a3aa-422e-944c-44f4692771b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-809f657b-a3aa-422e-944c-44f4692771b9', 'volume_size': 1} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:42 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b" returned: 0 in 0.902s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:36:42 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Converted 1024.00 MB image at 191.69 MB/s Apr 29 10:36:42 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 is being set with open permissions: ugo+rw Apr 29 10:36:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:43 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 Apr 29 10:36:43 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:43 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722" returned: 0 in 0.582s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Lock "cinder-quobyte-563ccbbe-bd25-447a-b6de-f9ad53846722" released by "_copy_volume_from_snapshot" :: held 8.494s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Acquiring lock "cinder-quobyte-0a88b65a-cbec-41e0-9af9-17f46dc4bda2" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Lock "cinder-quobyte-0a88b65a-cbec-41e0-9af9-17f46dc4bda2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Deleting offline snapshot 0a88b65a-cbec-41e0-9af9-17f46dc4bda2 of volume d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:36:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] snapshot_file for this snap is: volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:36:43 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca858cc-0d5f-4dab-a294-766eef3a43bb]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:43 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 Apr 29 10:36:43 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:44 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2" returned: 0 in 0.661s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:36:44 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f01c730-c807-492c-b247-7731210b8d45]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:44 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b Apr 29 10:36:44 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:44 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b" returned: 0 in 0.667s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:45 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 Apr 29 10:36:45 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:45 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2" returned: 0 in 0.659s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:45 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2 Apr 29 10:36:45 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:46 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b.0a88b65a-cbec-41e0-9af9-17f46dc4bda2" returned: 0 in 0.615s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Lock "cinder-quobyte-0a88b65a-cbec-41e0-9af9-17f46dc4bda2" released by "_delete_snapshot" :: held 2.698s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.652s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.921s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-135651116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf49031c-ab2b-4893-8072-4595e348fb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:33Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Creating volume bf49031c-ab2b-4893-8072-4595e348fb9b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:46 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:46 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b 1073741824 Apr 29 10:36:46 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0379b035-a378-429b-9891-f4b4b7a6f335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563ccbbe-bd25-447a-b6de-f9ad53846722', 'volume_size': 2, 'source_volid': 'd4b1bb46-3817-4ec3-a4dc-73fa65106d7b', 'source_volstatus': 'available'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60293fb-9a56-48f3-b1c9-a41c8383f6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:46 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Volume volume-563ccbbe-bd25-447a-b6de-f9ad53846722 (563ccbbe-bd25-447a-b6de-f9ad53846722): created successfully Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60293fb-9a56-48f3-b1c9-a41c8383f6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Flow 'volume_create_manager' (a1266102-59cb-474c-86e6-3f946f62216d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:46 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-1723fbbf-52a2-4163-a66e-5a812e0dceaa tempest-VolumesCloneTest-1459226055 None] Created volume successfully. Apr 29 10:36:47 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b 1073741824" returned: 0 in 0.843s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:47 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b Apr 29 10:36:47 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Acquiring lock "cinder-563ccbbe-bd25-447a-b6de-f9ad53846722-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Lock "cinder-563ccbbe-bd25-447a-b6de-f9ad53846722-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Acquiring lock "cinder-quobyte-563ccbbe-bd25-447a-b6de-f9ad53846722" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Lock "cinder-quobyte-563ccbbe-bd25-447a-b6de-f9ad53846722" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8047ddeb-4205-4e58-a3a5-d11d5379bb5e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:47 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 Apr 29 10:36:47 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:47 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b" returned: 0 in 0.722s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.255s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-895346614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ded16f4-76cf-4a10-86b4-8d1d85522e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:36Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Creating volume 9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:47 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:48 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 1073741824 Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862d85f0-e32d-4a69-96b2-942103ca3b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf49031c-ab2b-4893-8072-4595e348fb9b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:48 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea462424-634e-4fc8-802b-7d70de1b718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:48 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Volume volume-bf49031c-ab2b-4893-8072-4595e348fb9b (bf49031c-ab2b-4893-8072-4595e348fb9b): created successfully Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea462424-634e-4fc8-802b-7d70de1b718f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (bd818d15-f6a5-42bd-b97b-0a7ae82fd155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:48 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2cbfd4fa-6c33-4e23-b624-8c8e3dc98c32 tempest-VolumesActionsTest-40164440 None] Created volume successfully. Apr 29 10:36:48 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722" returned: 0 in 0.839s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:48 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722 Apr 29 10:36:48 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "cinder-bf49031c-ab2b-4893-8072-4595e348fb9b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-bf49031c-ab2b-4893-8072-4595e348fb9b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "cinder-quobyte-bf49031c-ab2b-4893-8072-4595e348fb9b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-quobyte-bf49031c-ab2b-4893-8072-4595e348fb9b" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51fe5b7-d93b-4aad-a824-4ecd6403dfad]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:48 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b Apr 29 10:36:48 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:49 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 1073741824" returned: 0 in 1.043s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:49 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 Apr 29 10:36:49 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:49 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-563ccbbe-bd25-447a-b6de-f9ad53846722" returned: 0 in 0.812s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Lock "cinder-quobyte-563ccbbe-bd25-447a-b6de-f9ad53846722" released by "delete_volume" :: held 1.701s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Created reservations ['5a046986-2a91-43ff-ac9c-c6ff11d38b40', '82220fa4-8e09-49b3-88e0-068c40646ebb', '50d4aa9f-ca13-4dce-af26-e035fc1c1a58', '929b1cff-70af-49f1-b9d3-15574e10e650'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:49 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:49 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:49 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b" returned: 0 in 0.824s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:49 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b Apr 29 10:36:49 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:49 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37" returned: 0 in 0.696s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.572s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1818423803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809f657b-a3aa-422e-944c-44f4692771b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae455d60eb649559754c34ef62e8e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:42Z,use_quota=True,user_id='0a924ffaefbf48a9ae68bc5509a165af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Creating volume 809f657b-a3aa-422e-944c-44f4692771b9 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:49 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:49 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9 1073741824 Apr 29 10:36:49 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd605d15-c24b-4961-876d-fe31e41855f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e61784-6828-47ec-b693-52147f12f414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:49 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Volume volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 (9ded16f4-76cf-4a10-86b4-8d1d85522e37): created successfully Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e61784-6828-47ec-b693-52147f12f414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (f03dcd9d-470f-429b-a7a7-3ba5518b36f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:49 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-41718a2b-be12-4687-9431-88f5c774f88c tempest-VolumesGetTest-1234097105 None] Created volume successfully. Apr 29 10:36:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Acquiring lock "cinder-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Lock "cinder-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Acquiring lock "cinder-quobyte-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Lock "cinder-quobyte-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a042c4-6cd5-4f78-ac77-749175b83f58]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:50 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.753s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:50 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Deleted volume successfully. Apr 29 10:36:50 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b Apr 29 10:36:50 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93b7da67-2ebd-4092-8e2b-13a4bee11b43 tempest-VolumesCloneTest-1459226055 None] Lock "cinder-563ccbbe-bd25-447a-b6de-f9ad53846722-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:50 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bf49031c-ab2b-4893-8072-4595e348fb9b" returned: 0 in 0.782s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-quobyte-bf49031c-ab2b-4893-8072-4595e348fb9b" released by "delete_volume" :: held 1.655s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Created reservations ['08e47052-7690-4003-806d-416bb3fc98c8', 'e28a48c1-739c-49ca-914c-95a96f79da5f', '2c83981b-d359-4656-9c63-35f68207cf6d', '32f985ab-2e01-415d-aede-52c793386754'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:50 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:50 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:50 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:50 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9 1073741824" returned: 0 in 1.079s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b" returned: 0 in 0.769s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:50 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b Apr 29 10:36:50 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:51 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9 Apr 29 10:36:51 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:51 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.886s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Deleted volume successfully. Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40f1ede0-e9ad-438e-88a5-1abcb0575731 tempest-VolumesActionsTest-1859689697 None] Lock "cinder-bf49031c-ab2b-4893-8072-4595e348fb9b-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:51 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9" returned: 0 in 0.843s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (bdb597df-b569-4cef-a1e7-ef17014571a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10836567-96c6-4604-a7d7-6751d4b8752a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1943d8ec-532a-4820-b5a0-11b82ff538eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809f657b-a3aa-422e-944c-44f4692771b9', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:51 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09ba2bd-1cdd-4260-87aa-1e885d4f7ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (53b1dd67-fcb2-4018-bd0f-613ee3eeb6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3017b1d2-df80-4c15-91fb-c98c42df6ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10836567-96c6-4604-a7d7-6751d4b8752a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1947163236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02aa2ac-9bc3-4812-b852-fed685f790d8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9ded16f4-76cf-4a10-86b4-8d1d85522e37,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:52Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b693893-bac3-4ebb-aa89-81e79d3ffc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b693893-bac3-4ebb-aa89-81e79d3ffc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08904f9e-968b-484d-8ff9-d18bc38b3b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:51 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Volume volume-809f657b-a3aa-422e-944c-44f4692771b9 (809f657b-a3aa-422e-944c-44f4692771b9): created successfully Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09ba2bd-1cdd-4260-87aa-1e885d4f7ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Flow 'volume_create_manager' (21ddb74c-b11a-4bbf-8c62-46f4c8eb7f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b" returned: 0 in 1.057s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08904f9e-968b-484d-8ff9-d18bc38b3b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e02aa2ac-9bc3-4812-b852-fed685f790d8', 'volume_name': 'volume-e02aa2ac-9bc3-4812-b852-fed685f790d8', 'volume_size': 1, 'source_volid': '9ded16f4-76cf-4a10-86b4-8d1d85522e37', 'source_volstatus': 'available'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f747edbe-f88b-44d2-bc7e-50898e513307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f747edbe-f88b-44d2-bc7e-50898e513307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a57d0e-61a0-4483-8314-c65fa43190cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:52 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Volume e02aa2ac-9bc3-4812-b852-fed685f790d8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e02aa2ac-9bc3-4812-b852-fed685f790d8', 'volume_size': 1, 'source_volid': '9ded16f4-76cf-4a10-86b4-8d1d85522e37', 'source_volstatus': 'available'} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3017b1d2-df80-4c15-91fb-c98c42df6ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-301715220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da7938c-b8dc-4118-b679-da7b164e002b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:52Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d0af4f-2333-4185-815b-f3803c930c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d0af4f-2333-4185-815b-f3803c930c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06965012-9d7a-492d-aaf5-fe0d57f871b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06965012-9d7a-492d-aaf5-fe0d57f871b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da7938c-b8dc-4118-b679-da7b164e002b', 'volume_name': 'volume-4da7938c-b8dc-4118-b679-da7b164e002b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a6c39d-dd6d-4b55-8f24-6aeb2149334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a6c39d-dd6d-4b55-8f24-6aeb2149334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb12eaef-48cc-40b6-aba3-fa418b6073f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:52 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Volume 4da7938c-b8dc-4118-b679-da7b164e002b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da7938c-b8dc-4118-b679-da7b164e002b', 'volume_size': 1} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-301715220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da7938c-b8dc-4118-b679-da7b164e002b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a2355cf6f234ca6b65bfb5f87763a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:52Z,use_quota=True,user_id='a82b6accda6f4e1ba318fedc3969ad4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Creating volume 4da7938c-b8dc-4118-b679-da7b164e002b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:36:52 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Lock "cinder-quobyte-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b" released by "delete_volume" :: held 2.006s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:52 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b79b438e-5ce9-4943-b7dd-97f20045705e tempest-VolumeQuotasAdminTestJSON-474484681 None] Created volume successfully. Apr 29 10:36:52 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b 1073741824 Apr 29 10:36:52 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Created reservations ['56b46785-fadb-4012-a578-f9a1cb865593', '10f8c198-635a-4170-828d-f10c5d1238a9', '407fe107-b5f1-43be-a2c6-58d03d41fe10', '8d64c447-5cfe-4cca-b18a-563ad9f4dd04'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:52 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:52 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:52 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.710s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Acquiring lock "cinder-809f657b-a3aa-422e-944c-44f4692771b9-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:52 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Deleted volume successfully. Apr 29 10:36:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "cinder-809f657b-a3aa-422e-944c-44f4692771b9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-329159d3-134e-49d6-be41-06ec4008e3b0 tempest-VolumesCloneTest-1459226055 None] Lock "cinder-d4b1bb46-3817-4ec3-a4dc-73fa65106d7b-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:53 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b 1073741824" returned: 0 in 0.981s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Acquiring lock "cinder-quobyte-809f657b-a3aa-422e-944c-44f4692771b9" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "cinder-quobyte-809f657b-a3aa-422e-944c-44f4692771b9" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a26ef6-4483-42ac-8a4c-c0b513b83cb3]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:53 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b Apr 29 10:36:53 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:53 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9 Apr 29 10:36:53 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:53 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b" returned: 0 in 0.685s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.696s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:53 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Cloning volume 9ded16f4-76cf-4a10-86b4-8d1d85522e37 to volume e02aa2ac-9bc3-4812-b852-fed685f790d8 Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb12eaef-48cc-40b6-aba3-fa418b6073f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da7938c-b8dc-4118-b679-da7b164e002b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6110f534-6c23-47ed-837e-c0c49ea68714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:53 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Volume volume-4da7938c-b8dc-4118-b679-da7b164e002b (4da7938c-b8dc-4118-b679-da7b164e002b): created successfully Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6110f534-6c23-47ed-837e-c0c49ea68714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Flow 'volume_create_manager' (53b1dd67-fcb2-4018-bd0f-613ee3eeb6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Creating offline snapshot 308d8e3b-d4cc-4cbe-a43d-93c67602506f of volume 9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:36:53 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7aff6914-d3cf-4358-8deb-1ec2e9ee1ba6 tempest-VolumesActionsTest-40164440 None] Created volume successfully. Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[08640bc3-31f0-4cd3-8fb6-ef8429ae21c7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:54 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:54 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 Apr 29 10:36:54 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9" returned: 0 in 0.939s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:54 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9 Apr 29 10:36:54 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:54 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-809f657b-a3aa-422e-944c-44f4692771b9" returned: 0 in 0.652s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "cinder-quobyte-809f657b-a3aa-422e-944c-44f4692771b9" released by "delete_volume" :: held 1.662s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:54 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37" returned: 0 in 0.831s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:54 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f 1G Apr 29 10:36:54 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Created reservations ['7a895a18-eac4-4ff5-ba48-fbf28e88c07e', '1638f9a8-f41d-4900-9984-158a4df3d1cb', '10fa6d62-bcbc-4538-8809-e11306c1282a', '6f43f09d-9ffb-4658-8a3d-d0c1bb98c18b'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:54 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:54 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:55 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f 1G" returned: 0 in 0.822s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:55 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f Apr 29 10:36:55 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:55 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.742s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:55 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:55 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Deleted volume successfully. Apr 29 10:36:55 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-49f69197-49c3-474c-8813-e1c3c9a63b86 tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "cinder-809f657b-a3aa-422e-944c-44f4692771b9-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Flow 'volume_create_manager' (b8183cd9-ad21-4c11-a27a-fa9ded50d54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653b4315-dbdd-4b98-818d-d2df01bdef32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653b4315-dbdd-4b98-818d-d2df01bdef32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-166726080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a568ba-82d8-4b10-a827-d2ecac1ae185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae455d60eb649559754c34ef62e8e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:56Z,use_quota=True,user_id='0a924ffaefbf48a9ae68bc5509a165af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ab8b34-fbdc-43e4-b877-52e7cd6c3ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ab8b34-fbdc-43e4-b877-52e7cd6c3ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadda48c-0632-4e93-85df-82c47cc9c033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadda48c-0632-4e93-85df-82c47cc9c033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a568ba-82d8-4b10-a827-d2ecac1ae185', 'volume_name': 'volume-16a568ba-82d8-4b10-a827-d2ecac1ae185', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6c5849-57b0-46fd-b828-a3292cf97059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6c5849-57b0-46fd-b828-a3292cf97059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1404985-328e-4060-b6ff-f58177305514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:56 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Volume 16a568ba-82d8-4b10-a827-d2ecac1ae185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a568ba-82d8-4b10-a827-d2ecac1ae185', 'volume_size': 1} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Flow 'volume_create_manager' (7256b15f-5554-4957-9780-19a64c4e26f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fc8ad1-db85-4339-8913-d6bb24786157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Acquiring lock "cinder-4da7938c-b8dc-4118-b679-da7b164e002b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fc8ad1-db85-4339-8913-d6bb24786157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2072960725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91b3892-1f44-4690-941a-c00f7bac3b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd7fb01d094751b7210504c53a599d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:56Z,use_quota=True,user_id='b4321dc8a6da46949d9bb2cf6ce8a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d888d8-9bcd-42ab-9e4c-062fa4925611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d888d8-9bcd-42ab-9e4c-062fa4925611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b190da5-9d7f-4658-9178-8e4f34eaa411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b190da5-9d7f-4658-9178-8e4f34eaa411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd91b3892-1f44-4690-941a-c00f7bac3b50', 'volume_name': 'volume-d91b3892-1f44-4690-941a-c00f7bac3b50', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ea8077-f45d-4961-b7a1-1d3910db6d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ea8077-f45d-4961-b7a1-1d3910db6d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4358157a-f236-4d98-9d98-ab0e72f7b6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:36:56 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Volume d91b3892-1f44-4690-941a-c00f7bac3b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d91b3892-1f44-4690-941a-c00f7bac3b50', 'volume_size': 1} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Lock "cinder-4da7938c-b8dc-4118-b679-da7b164e002b-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Acquiring lock "cinder-quobyte-4da7938c-b8dc-4118-b679-da7b164e002b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Lock "cinder-quobyte-4da7938c-b8dc-4118-b679-da7b164e002b" acquired by "delete_volume" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0957a323-51ea-4bfa-96f0-1df6fb376208]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:56 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f" returned: 0 in 0.812s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:56 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f is being set with open permissions: ugo+rw Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:56 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f Apr 29 10:36:56 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:56 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b Apr 29 10:36:56 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:56 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f" returned: 0 in 0.577s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:57 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.info Apr 29 10:36:57 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:57 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b" returned: 0 in 0.737s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:57 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b Apr 29 10:36:57 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:57 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.info" returned: 0 in 0.613s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:57 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.info is being set with open permissions: ugo+rw Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:57 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4da7938c-b8dc-4118-b679-da7b164e002b" returned: 0 in 0.569s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:57 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.info Apr 29 10:36:57 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Lock "cinder-quobyte-4da7938c-b8dc-4118-b679-da7b164e002b" released by "delete_volume" :: held 1.349s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Created reservations ['9b42c002-ef55-47a3-b35b-37b025c445d3', '25d8144c-29b5-4b48-819b-5a0a42e381cd', 'be0dde75-8651-46c7-8786-fd40e3d25038', '041132ad-9747-4539-9762-3ad3b2a351ab'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:57 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:36:57 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:58 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.info" returned: 0 in 0.605s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-quobyte-e02aa2ac-9bc3-4812-b852-fed685f790d8" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-e02aa2ac-9bc3-4812-b852-fed685f790d8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] snapshot: 308d8e3b-d4cc-4cbe-a43d-93c67602506f, volume: e02aa2ac-9bc3-4812-b852-fed685f790d8, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d35bf4-0265-4d12-846a-098e76c5ad03]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:58 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.641s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:36:58 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f Apr 29 10:36:58 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:58 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Deleted volume successfully. Apr 29 10:36:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4cdd07e-d592-4ff0-86b1-2678b6430b3e tempest-VolumesActionsTest-40164440 None] Lock "cinder-4da7938c-b8dc-4118-b679-da7b164e002b-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:36:59 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f" returned: 0 in 0.770s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:36:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:36:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:36:59 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1c6ebd-14f9-4505-b7cf-73aadb15b289]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:36:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:59 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 Apr 29 10:36:59 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:36:59 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 29 10:36:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37" returned: 0 in 0.764s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:36:59 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:36:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:36:59 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 Apr 29 10:36:59 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:04 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8" returned: 0 in 4.958s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:04 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e88c81-6aa9-4075-9de2-863d43d2abfc]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:04 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 Apr 29 10:37:04 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:05 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37" returned: 0 in 0.868s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:05 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:37:05 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Converted 1024.00 MB image at 206.49 MB/s Apr 29 10:37:05 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 is being set with open permissions: ugo+rw Apr 29 10:37:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:05 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 Apr 29 10:37:05 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:06 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8" returned: 0 in 0.711s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-e02aa2ac-9bc3-4812-b852-fed685f790d8" released by "_copy_volume_from_snapshot" :: held 8.147s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-quobyte-308d8e3b-d4cc-4cbe-a43d-93c67602506f" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-308d8e3b-d4cc-4cbe-a43d-93c67602506f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Deleting offline snapshot 308d8e3b-d4cc-4cbe-a43d-93c67602506f of volume 9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:37:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] snapshot_file for this snap is: volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:37:06 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3780136-639f-4de8-bec2-26ac13bc5ea8]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:06 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f Apr 29 10:37:06 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:07 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f" returned: 0 in 0.834s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:37:07 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3a73ed-42ac-4d0c-ac19-ce03018588b7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:07 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 Apr 29 10:37:07 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:08 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37" returned: 0 in 0.788s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:08 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f Apr 29 10:37:08 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:08 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=38,cinder:UPDATE=53,cinder:INSERT=17,cinder:DELETE=4 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:37:08 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f" returned: 0 in 0.702s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:08 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f Apr 29 10:37:08 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:09 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37.308d8e3b-d4cc-4cbe-a43d-93c67602506f" returned: 0 in 0.611s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-308d8e3b-d4cc-4cbe-a43d-93c67602506f" released by "_delete_snapshot" :: held 3.040s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.711s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.389s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-166726080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a568ba-82d8-4b10-a827-d2ecac1ae185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae455d60eb649559754c34ef62e8e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:56Z,use_quota=True,user_id='0a924ffaefbf48a9ae68bc5509a165af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Creating volume 16a568ba-82d8-4b10-a827-d2ecac1ae185 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:09 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:09 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185 1073741824 Apr 29 10:37:09 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a57d0e-61a0-4483-8314-c65fa43190cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02aa2ac-9bc3-4812-b852-fed685f790d8', 'volume_size': 1, 'source_volid': '9ded16f4-76cf-4a10-86b4-8d1d85522e37', 'source_volstatus': 'available'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9ac578-5516-456d-9862-8358a55b671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:09 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Volume volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 (e02aa2ac-9bc3-4812-b852-fed685f790d8): created successfully Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9ac578-5516-456d-9862-8358a55b671a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (bdb597df-b569-4cef-a1e7-ef17014571a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:09 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-385ab795-8cf3-4a8f-a117-50088d1ed5e9 tempest-VolumesGetTest-1234097105 None] Created volume successfully. Apr 29 10:37:10 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185 1073741824" returned: 0 in 0.911s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:10 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185 Apr 29 10:37:10 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (a991d2d4-4071-4177-85c9-d3b201f74fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a23f7b-a2c3-456c-b18f-f1897949b42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a23f7b-a2c3-456c-b18f-f1897949b42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1622173593',display_name='tempest-VolumesGetTest-Volume-161041848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d1553b-d20d-41ab-9cb7-22d839085c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:11Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5b4bdb-e10d-41ad-aae4-816ca7d4d404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5b4bdb-e10d-41ad-aae4-816ca7d4d404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66771be-7861-42ff-8023-ddba4cf4d2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66771be-7861-42ff-8023-ddba4cf4d2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d1553b-d20d-41ab-9cb7-22d839085c06', 'volume_name': 'volume-50d1553b-d20d-41ab-9cb7-22d839085c06', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84dd52e-c879-4bae-91af-84c43e65148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84dd52e-c879-4bae-91af-84c43e65148d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e329ca-9718-450f-a2b1-3e0b695e54cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:10 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Volume 50d1553b-d20d-41ab-9cb7-22d839085c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d1553b-d20d-41ab-9cb7-22d839085c06', 'volume_size': 1} Apr 29 10:37:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:11 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185" returned: 0 in 0.631s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.857s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2072960725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91b3892-1f44-4690-941a-c00f7bac3b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8dd7fb01d094751b7210504c53a599d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:36:56Z,use_quota=True,user_id='b4321dc8a6da46949d9bb2cf6ce8a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Creating volume d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:11 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:11 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 1073741824 Apr 29 10:37:11 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1404985-328e-4060-b6ff-f58177305514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a568ba-82d8-4b10-a827-d2ecac1ae185', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3081d2-8e00-4e58-a879-d47e7c25222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:11 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Volume volume-16a568ba-82d8-4b10-a827-d2ecac1ae185 (16a568ba-82d8-4b10-a827-d2ecac1ae185): created successfully Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3081d2-8e00-4e58-a879-d47e7c25222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Flow 'volume_create_manager' (b8183cd9-ad21-4c11-a27a-fa9ded50d54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:11 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-265be7be-204b-4022-80ae-643e467ed77c tempest-VolumeQuotasAdminTestJSON-474484681 None] Created volume successfully. Apr 29 10:37:11 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 1073741824" returned: 0 in 0.878s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:12 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 Apr 29 10:37:12 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:12 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50" returned: 0 in 0.660s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.794s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1622173593',display_name='tempest-VolumesGetTest-Volume-161041848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d1553b-d20d-41ab-9cb7-22d839085c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:11Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Creating volume 50d1553b-d20d-41ab-9cb7-22d839085c06 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:12 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4358157a-f236-4d98-9d98-ab0e72f7b6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d91b3892-1f44-4690-941a-c00f7bac3b50', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:12 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06 1073741824 Apr 29 10:37:12 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d52f09-fbcc-4050-b991-cb0144ba7997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:12 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Volume volume-d91b3892-1f44-4690-941a-c00f7bac3b50 (d91b3892-1f44-4690-941a-c00f7bac3b50): created successfully Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d52f09-fbcc-4050-b991-cb0144ba7997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Flow 'volume_create_manager' (7256b15f-5554-4957-9780-19a64c4e26f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:12 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-80f81906-4ecf-4167-b972-7cab615b12bd tempest-VolumesSnapshotListTestJSON-1249411918 None] Created volume successfully. Apr 29 10:37:13 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-213633e8-6199-444a-bcc5-8d5c7cd59e39 tempest-VolumeQuotasAdminTestJSON-1551107629 None] Transfer volume completed successfully. Apr 29 10:37:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:13 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06 1073741824" returned: 0 in 0.935s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:13 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06 Apr 29 10:37:13 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Acquiring lock "cinder-16a568ba-82d8-4b10-a827-d2ecac1ae185-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Lock "cinder-16a568ba-82d8-4b10-a827-d2ecac1ae185-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Acquiring lock "cinder-quobyte-16a568ba-82d8-4b10-a827-d2ecac1ae185" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Lock "cinder-quobyte-16a568ba-82d8-4b10-a827-d2ecac1ae185" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e64e2-8103-4dea-b2eb-88e59bf4b743]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:14 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06" returned: 0 in 0.662s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:14 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185 Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.713s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:14 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Creating offline snapshot 24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca of volume d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e329ca-9718-450f-a2b1-3e0b695e54cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d1553b-d20d-41ab-9cb7-22d839085c06', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74ac6a9-1060-4d5e-bc90-47df8a950b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[3915743a-f0af-4e22-9b68-859dd3a0a9c8]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:14 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Volume volume-50d1553b-d20d-41ab-9cb7-22d839085c06 (50d1553b-d20d-41ab-9cb7-22d839085c06): created successfully Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74ac6a9-1060-4d5e-bc90-47df8a950b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (a991d2d4-4071-4177-85c9-d3b201f74fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:14 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e85f9d89-10e5-4bad-a1c4-50187ceeeec5 tempest-VolumesGetTest-1234097105 None] Created volume successfully. Apr 29 10:37:14 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 Apr 29 10:37:14 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:14 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185" returned: 0 in 0.722s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:14 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185 Apr 29 10:37:14 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:15 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50" returned: 0 in 0.871s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:15 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca 1G Apr 29 10:37:15 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Flow 'volume_create_manager' (f648044d-1fc1-4299-9fa9-49c76859adb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406ec22e-9461-479f-b4a4-7c2cd648f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-50d1553b-d20d-41ab-9cb7-22d839085c06-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406ec22e-9461-479f-b4a4-7c2cd648f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-140752480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35caf7ca-627f-428f-8610-13f66bd007a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e4a32dff0c4657af79d29e60a30cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:15Z,use_quota=True,user_id='06032dbd0ba941d89f691a345a8245ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2db4e44-964f-4dc2-8596-dc182573bcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2db4e44-964f-4dc2-8596-dc182573bcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e7222b-5422-45c8-ae8a-db4501ff8471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e7222b-5422-45c8-ae8a-db4501ff8471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35caf7ca-627f-428f-8610-13f66bd007a6', 'volume_name': 'volume-35caf7ca-627f-428f-8610-13f66bd007a6', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cd3624-e412-4d61-89fe-11e3b1dc596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cd3624-e412-4d61-89fe-11e3b1dc596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d1387e-4c7b-4495-9788-17de99bf1e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:15 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Volume 35caf7ca-627f-428f-8610-13f66bd007a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35caf7ca-627f-428f-8610-13f66bd007a6', 'volume_size': 1} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Lock "cinder-50d1553b-d20d-41ab-9cb7-22d839085c06-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-quobyte-50d1553b-d20d-41ab-9cb7-22d839085c06" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-50d1553b-d20d-41ab-9cb7-22d839085c06" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bd68d6-0e89-47eb-a443-3f5387710de2]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:15 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06 Apr 29 10:37:15 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:15 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-16a568ba-82d8-4b10-a827-d2ecac1ae185" returned: 0 in 0.745s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Lock "cinder-quobyte-16a568ba-82d8-4b10-a827-d2ecac1ae185" released by "delete_volume" :: held 1.516s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Created reservations ['221728f4-25c2-4253-9eca-8c89db6aa553', 'f811ab81-c88d-4eb9-8db1-0c1b206e41fa', '39ad51b1-d23c-48ee-b8b4-42d7123532d1', 'e8d5a8d4-eefc-40d0-ae17-ff68908d8168'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:15 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:15 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:16 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca 1G" returned: 0 in 0.815s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91b3892-1f44-4690-941a-c00f7bac3b50 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:16 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91b3892-1f44-4690-941a-c00f7bac3b50 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca Apr 29 10:37:16 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:16 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06" returned: 0 in 0.732s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:16 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06 Apr 29 10:37:16 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:16 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.626s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:16 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Deleted volume successfully. Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2c96becc-9aff-4393-a65a-d6c1e13c2d53 tempest-VolumeQuotasAdminTestJSON-1318731812 None] Lock "cinder-16a568ba-82d8-4b10-a827-d2ecac1ae185-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:16 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91b3892-1f44-4690-941a-c00f7bac3b50 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca" returned: 0 in 0.750s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:16 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca is being set with open permissions: ugo+rw Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:16 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca Apr 29 10:37:16 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:16 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-50d1553b-d20d-41ab-9cb7-22d839085c06" returned: 0 in 0.708s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-50d1553b-d20d-41ab-9cb7-22d839085c06" released by "delete_volume" :: held 1.487s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Created reservations ['30725f58-b1a5-4752-a74c-9f187ddaecf4', '9169354e-cc61-441d-b493-e965e47f374f', '9546ece3-6806-4198-acd1-1e27172ae2cf', 'e2d004dd-3274-45a6-931a-440f8d219e41'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:17 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:17 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:17 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca" returned: 0 in 0.636s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:17 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.info Apr 29 10:37:17 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-e02aa2ac-9bc3-4812-b852-fed685f790d8-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Lock "cinder-e02aa2ac-9bc3-4812-b852-fed685f790d8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-quobyte-e02aa2ac-9bc3-4812-b852-fed685f790d8" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-e02aa2ac-9bc3-4812-b852-fed685f790d8" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:17 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.684s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b527176a-1b61-47eb-aaa1-7fa561b1809d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:17 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Deleted volume successfully. Apr 29 10:37:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5fd9ffdf-33c1-454d-82b1-eb7f730176d7 tempest-VolumesGetTest-1234097105 None] Lock "cinder-50d1553b-d20d-41ab-9cb7-22d839085c06-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:17 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 Apr 29 10:37:17 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:18 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.info" returned: 0 in 0.700s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:18 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.info is being set with open permissions: ugo+rw Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:18 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.info Apr 29 10:37:18 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:18 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8" returned: 0 in 0.798s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:18 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8 Apr 29 10:37:18 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:18 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.info" returned: 0 in 0.639s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.525s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.444s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-140752480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35caf7ca-627f-428f-8610-13f66bd007a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e4a32dff0c4657af79d29e60a30cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:15Z,use_quota=True,user_id='06032dbd0ba941d89f691a345a8245ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Creating volume 35caf7ca-627f-428f-8610-13f66bd007a6 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:18 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:18 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6 1073741824 Apr 29 10:37:18 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:18 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4358e3cc-9222-48ed-aced-d7f91fb58a94 tempest-VolumesSnapshotListTestJSON-1249411918 None] Create snapshot completed successfully Apr 29 10:37:19 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-e02aa2ac-9bc3-4812-b852-fed685f790d8" returned: 0 in 0.704s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-e02aa2ac-9bc3-4812-b852-fed685f790d8" released by "delete_volume" :: held 1.554s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Created reservations ['dcaac124-84b6-4e60-b693-b75e32fe9f9b', '8024078a-853d-492e-9057-4d620a5121d1', 'f8a2e541-a8f4-472c-a6d7-ab1adfcd73ac', '42ed6d5b-a32b-47b5-8cdf-1d951e4899bd'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:19 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:19 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:19 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6 1073741824" returned: 0 in 0.936s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:19 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6 Apr 29 10:37:19 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-9ded16f4-76cf-4a10-86b4-8d1d85522e37-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Lock "cinder-9ded16f4-76cf-4a10-86b4-8d1d85522e37-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-quobyte-9ded16f4-76cf-4a10-86b4-8d1d85522e37" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-9ded16f4-76cf-4a10-86b4-8d1d85522e37" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a3bb0d-5aa7-4295-8348-fb7839eb560e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:20 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.800s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:20 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Deleted volume successfully. Apr 29 10:37:20 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 Apr 29 10:37:20 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e47a0cd9-69f2-4614-be30-6ce618a16497 tempest-VolumesGetTest-1234097105 None] Lock "cinder-e02aa2ac-9bc3-4812-b852-fed685f790d8-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:20 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6" returned: 0 in 0.851s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.500s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d1387e-4c7b-4495-9788-17de99bf1e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35caf7ca-627f-428f-8610-13f66bd007a6', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abac250e-54ad-4cdd-b501-e6bde0d86beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] Creating offline snapshot 62454cc3-27bf-49b1-b60e-ff58159f7216 of volume d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:37:20 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Volume volume-35caf7ca-627f-428f-8610-13f66bd007a6 (35caf7ca-627f-428f-8610-13f66bd007a6): created successfully Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abac250e-54ad-4cdd-b501-e6bde0d86beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Flow 'volume_create_manager' (f648044d-1fc1-4299-9fa9-49c76859adb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2b859b-ebd8-49f7-88c8-96b58f490fad]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:20 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-09befed8-6906-48c8-a1e1-a8d79c74f49b tempest-VolumesTransfersV357Test-1432826934 None] Created volume successfully. Apr 29 10:37:20 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca Apr 29 10:37:20 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:21 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37" returned: 0 in 0.833s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:21 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37 Apr 29 10:37:21 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:21 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca" returned: 0 in 0.763s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91b3892-1f44-4690-941a-c00f7bac3b50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:21 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 1G Apr 29 10:37:21 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:21 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9ded16f4-76cf-4a10-86b4-8d1d85522e37" returned: 0 in 0.690s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-9ded16f4-76cf-4a10-86b4-8d1d85522e37" released by "delete_volume" :: held 1.630s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Created reservations ['1740a8da-d58c-49dd-972a-4db91553d2c2', '66cb9d02-23d4-48c8-ad0b-52cc199a3a25', 'a8d5e32b-2114-44a5-9e04-83c2ed643917', 'a47b20e3-618d-4b29-8132-9caf90521b65'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:21 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:21 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:22 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.756s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:22 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:22 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Deleted volume successfully. Apr 29 10:37:22 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7b50945a-85e3-4595-a23e-82b00d163649 tempest-VolumesTransfersV357Test-467403210 None] Transfer volume completed successfully. Apr 29 10:37:22 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-55dd51e4-7139-40c0-8378-6fb91264502b tempest-VolumesGetTest-1234097105 None] Lock "cinder-9ded16f4-76cf-4a10-86b4-8d1d85522e37-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:22 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 1G" returned: 0 in 1.136s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:22 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 Apr 29 10:37:22 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (de7f534e-566f-418e-bbb0-0a4a43b923a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c329fc4-1434-4120-82a3-119e1a143a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c329fc4-1434-4120-82a3-119e1a143a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-509146366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10a10f3-3e30-4485-ae58-b5fcfa1e3276,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:23Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6546e57-1fdf-4e4d-97e7-2f60adcaea65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6546e57-1fdf-4e4d-97e7-2f60adcaea65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd5deb0-78f0-4b58-a2c1-fb4ac2e87895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.image.glance [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Creating Keystone auth plugin from conf {{(pid=83806) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 10:37:23 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216" returned: 0 in 0.733s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:23 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 is being set with open permissions: ugo+rw Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:23 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 Apr 29 10:37:23 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Acquiring lock "cinder-35caf7ca-627f-428f-8610-13f66bd007a6-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Lock "cinder-35caf7ca-627f-428f-8610-13f66bd007a6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd5deb0-78f0-4b58-a2c1-fb4ac2e87895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f10a10f3-3e30-4485-ae58-b5fcfa1e3276', 'volume_name': 'volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a197fe-4b6a-4cb3-ba84-198d6197a01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a197fe-4b6a-4cb3-ba84-198d6197a01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db02c823-c483-4322-be70-0d0e40d798ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:23 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Volume f10a10f3-3e30-4485-ae58-b5fcfa1e3276: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Trying to clone f10a10f3-3e30-4485-ae58-b5fcfa1e3276 from image 79b62ee8-86ba-4c65-a753-39d7d038c9fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]). {{(pid=83806) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 10:37:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Acquiring lock "cinder-quobyte-35caf7ca-627f-428f-8610-13f66bd007a6" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Lock "cinder-quobyte-35caf7ca-627f-428f-8610-13f66bd007a6" acquired by "delete_volume" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f248e07-e34f-4c81-95db-04228795b0f2]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:24 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216" returned: 0 in 0.737s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:24 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6 Apr 29 10:37:24 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Flow 'volume_create_manager' (127b09f0-74da-4906-9a42-3416f1856783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae692924-ee00-45c6-8b1a-5eb92783515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.604s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae692924-ee00-45c6-8b1a-5eb92783515f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1564884752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74fff24c-7941-4845-8878-3dab29074ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd166e90e26e4170b495c7486c8565e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:24Z,use_quota=True,user_id='96b7728c3e714458ad871733b0d7573c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84194685-c1a6-468d-bac1-98716fd2ea4d),volume_type_id=84194685-c1a6-468d-bac1-98716fd2ea4d)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3498b2-0d18-4912-a310-1c44fb83e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3498b2-0d18-4912-a310-1c44fb83e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc6bca0-e674-4486-b0e6-ff7a49f39b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc6bca0-e674-4486-b0e6-ff7a49f39b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74fff24c-7941-4845-8878-3dab29074ba0', 'volume_name': 'volume-74fff24c-7941-4845-8878-3dab29074ba0', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b833e0-534d-4fe2-a250-c174f55d4a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b833e0-534d-4fe2-a250-c174f55d4a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fc79f7-093b-4945-8e1a-1b61c1b15761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:24 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Volume 74fff24c-7941-4845-8878-3dab29074ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74fff24c-7941-4845-8878-3dab29074ba0', 'volume_size': 1} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1564884752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74fff24c-7941-4845-8878-3dab29074ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd166e90e26e4170b495c7486c8565e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:24Z,use_quota=True,user_id='96b7728c3e714458ad871733b0d7573c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84194685-c1a6-468d-bac1-98716fd2ea4d),volume_type_id=84194685-c1a6-468d-bac1-98716fd2ea4d)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Creating volume 74fff24c-7941-4845-8878-3dab29074ba0 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:24 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:24 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0 1073741824 Apr 29 10:37:24 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:24 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-be09c446-6d4f-4bea-8fba-0b63bd2d78b7 tempest-VolumesSnapshotListTestJSON-1249411918 None] Create snapshot completed successfully Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 10:37:24 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Image download 20.69 MB at 20.69 MB/s Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3de7e6f-b4f2-4945-bacc-b7e629b8ebbc]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:24 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD Apr 29 10:37:24 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:24 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6" returned: 0 in 0.828s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:24 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6 Apr 29 10:37:24 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:25 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0 1073741824" returned: 0 in 0.839s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:25 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD" returned: 0 in 0.704s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Temporary image 79b62ee8-86ba-4c65-a753-39d7d038c9fd is fetched for user 5415c39b3a584f5bb24b3657a980730b. {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:25 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0 Apr 29 10:37:25 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b8a47-dd5b-4b3a-b8b3-7b2a53839b46]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:25 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD Apr 29 10:37:25 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:25 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35caf7ca-627f-428f-8610-13f66bd007a6" returned: 0 in 0.698s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Lock "cinder-quobyte-35caf7ca-627f-428f-8610-13f66bd007a6" released by "delete_volume" :: held 1.607s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Created reservations ['4977e25a-3075-41b4-8a89-49911d363a94', '045a4169-d9f6-4b09-b86a-0dbb17e1101e', '5e814816-72f0-497e-ae6d-882d54521308', '114ea1fe-7cc8-4300-adcf-b6716b263df9'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:25 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:25 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:26 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0" returned: 0 in 0.736s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.205s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] Creating offline snapshot 9b069ba5-795a-46ee-af75-db90b79951c4 of volume d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:37:26 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fc79f7-093b-4945-8e1a-1b61c1b15761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74fff24c-7941-4845-8878-3dab29074ba0', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54f01cf-8d87-4155-a267-a6c6cf0a1bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25cd6f2-fc7c-429e-ad4b-733638df972d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:26 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Volume volume-74fff24c-7941-4845-8878-3dab29074ba0 (74fff24c-7941-4845-8878-3dab29074ba0): created successfully Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54f01cf-8d87-4155-a267-a6c6cf0a1bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Flow 'volume_create_manager' (127b09f0-74da-4906-9a42-3416f1856783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:26 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-c1ef271d-eef3-420f-aed6-d20a9388e591 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Created volume successfully. Apr 29 10:37:26 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 Apr 29 10:37:26 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:26 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.677s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:26 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Deleted volume successfully. Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5867de46-6dd0-4d06-9dac-8ea8f11b293f tempest-VolumesTransfersV357Test-1508743279 None] Lock "cinder-35caf7ca-627f-428f-8610-13f66bd007a6-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Flow 'volume_create_manager' (d3aed4a9-dbc8-4ec3-937d-d7eb43ca78d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b27ffc-1e3a-4017-a8b2-27a41ae03b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b27ffc-1e3a-4017-a8b2-27a41ae03b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-865743342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40a6c1d-601c-4335-9015-857df528fd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e4a32dff0c4657af79d29e60a30cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:27Z,use_quota=True,user_id='06032dbd0ba941d89f691a345a8245ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093ca59c-111c-43f6-875d-527358dc2dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093ca59c-111c-43f6-875d-527358dc2dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88966806-3195-4060-9e80-cbbaf37ea6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88966806-3195-4060-9e80-cbbaf37ea6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd40a6c1d-601c-4335-9015-857df528fd49', 'volume_name': 'volume-d40a6c1d-601c-4335-9015-857df528fd49', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e3d393-853d-4cbe-b6ef-396bcf43e3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e3d393-853d-4cbe-b6ef-396bcf43e3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2de0ec8-e080-4bf6-a013-d599f00ed283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:26 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Volume d40a6c1d-601c-4335-9015-857df528fd49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d40a6c1d-601c-4335-9015-857df528fd49', 'volume_size': 1} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aefd9f50-1be4-40ff-ace9-b9306b4788cd tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aefd9f50-1be4-40ff-ace9-b9306b4788cd tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aefd9f50-1be4-40ff-ace9-b9306b4788cd tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aefd9f50-1be4-40ff-ace9-b9306b4788cd tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aefd9f50-1be4-40ff-ace9-b9306b4788cd tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aefd9f50-1be4-40ff-ace9-b9306b4788cd tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:26 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:26 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:26 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216" returned: 0 in 0.836s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91b3892-1f44-4690-941a-c00f7bac3b50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:37:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:26 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 1G Apr 29 10:37:26 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:27 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aefd9f50-1be4-40ff-ace9-b9306b4788cd tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.575s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:27 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-aefd9f50-1be4-40ff-ace9-b9306b4788cd tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:27 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-aefd9f50-1be4-40ff-ace9-b9306b4788cd tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Retype volume completed successfully. Apr 29 10:37:27 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 1G" returned: 0 in 0.843s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:27 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 Apr 29 10:37:27 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Acquiring lock "cinder-74fff24c-7941-4845-8878-3dab29074ba0-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "cinder-74fff24c-7941-4845-8878-3dab29074ba0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Acquiring lock "cinder-quobyte-74fff24c-7941-4845-8878-3dab29074ba0" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "cinder-quobyte-74fff24c-7941-4845-8878-3dab29074ba0" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:28 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d9fba2-962a-4c88-834d-d3dd11779e4b]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:28 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0 Apr 29 10:37:28 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:28 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4" returned: 0 in 0.655s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:28 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 is being set with open permissions: ugo+rw Apr 29 10:37:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:28 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 Apr 29 10:37:28 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:28 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0" returned: 0 in 0.776s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:28 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0 Apr 29 10:37:28 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:29 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4" returned: 0 in 0.570s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.025s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.943s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-509146366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10a10f3-3e30-4485-ae58-b5fcfa1e3276,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:23Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Creating volume f10a10f3-3e30-4485-ae58-b5fcfa1e3276 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:29 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:29 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 1073741824 Apr 29 10:37:29 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-636ee70e-7c26-46bf-b8ea-ac94f96da266 tempest-VolumesSnapshotListTestJSON-1249411918 None] Create snapshot completed successfully Apr 29 10:37:29 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-74fff24c-7941-4845-8878-3dab29074ba0" returned: 0 in 0.619s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "cinder-quobyte-74fff24c-7941-4845-8878-3dab29074ba0" released by "delete_volume" :: held 1.438s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:29 devstack cinder-volume[83806]: WARNING cinder.quota [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:37:29 devstack cinder-volume[83806]: WARNING cinder.quota [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Created reservations ['88de38f7-4c72-4328-8c26-5ccce652081a', '1e7f0c5a-9b62-4f83-b49d-554e74cc0ac9', '2276667f-d951-429d-b391-f88e8169219d', '50ebffb2-c589-42b0-af8a-6c6ddc574805'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:29 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:29 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:29 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 1073741824" returned: 0 in 0.801s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:29 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 Apr 29 10:37:29 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:30 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.655s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:30 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Deleted volume successfully. Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8fd6442e-993d-4415-8c59-0363667df2b8 tempest-VolumeRetypeWithoutMigrationTest-1400228564 None] Lock "cinder-74fff24c-7941-4845-8878-3dab29074ba0-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:30 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276" returned: 0 in 0.673s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.843s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-865743342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d40a6c1d-601c-4335-9015-857df528fd49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e4a32dff0c4657af79d29e60a30cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:27Z,use_quota=True,user_id='06032dbd0ba941d89f691a345a8245ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Creating volume d40a6c1d-601c-4335-9015-857df528fd49 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:30 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:30 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49 1073741824 Apr 29 10:37:30 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Attempting download of 79b62ee8-86ba-4c65-a753-39d7d038c9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}])) to volume f10a10f3-3e30-4485-ae58-b5fcfa1e3276. {{(pid=83806) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d1f2a0-7757-43a0-975e-accbea281c07]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_07s497oo {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:30 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_07s497oo Apr 29 10:37:30 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-9b069ba5-795a-46ee-af75-db90b79951c4-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-9b069ba5-795a-46ee-af75-db90b79951c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-quobyte-9b069ba5-795a-46ee-af75-db90b79951c4" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-9b069ba5-795a-46ee-af75-db90b79951c4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Deleting offline snapshot 9b069ba5-795a-46ee-af75-db90b79951c4 of volume d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] snapshot_file for this snap is: volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66d4a40-d122-469b-8b53-4b025f1c892f]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:31 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 Apr 29 10:37:31 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:31 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49 1073741824" returned: 0 in 0.915s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:31 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49 Apr 29 10:37:31 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:31 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_07s497oo" returned: 0 in 0.868s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_07s497oo {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:31 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_07s497oo Apr 29 10:37:31 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4" returned: 0 in 0.881s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91b3892-1f44-4690-941a-c00f7bac3b50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:37:31 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2ecf64-4db0-4302-a251-45ac10a963e6]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:32 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 Apr 29 10:37:32 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:32 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49" returned: 0 in 0.805s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2de0ec8-e080-4bf6-a013-d599f00ed283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d40a6c1d-601c-4335-9015-857df528fd49', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1715fc36-b32e-4608-ad74-cbe2229af4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:32 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Volume volume-d40a6c1d-601c-4335-9015-857df528fd49 (d40a6c1d-601c-4335-9015-857df528fd49): created successfully Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1715fc36-b32e-4608-ad74-cbe2229af4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Flow 'volume_create_manager' (d3aed4a9-dbc8-4ec3-937d-d7eb43ca78d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:32 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_07s497oo" returned: 1 in 0.862s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_07s497oo' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83c9b83-bb5d-49d3-94b8-b9b0f5772eb9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:32 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b8a889e2-5b90-4f69-8961-d444da860d5d tempest-VolumesTransfersV357Test-1432826934 None] Created volume successfully. Apr 29 10:37:32 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD Apr 29 10:37:32 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:32 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216" returned: 0 in 0.834s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91b3892-1f44-4690-941a-c00f7bac3b50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:37:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:32 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 Apr 29 10:37:32 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:33 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:33 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:33 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] 79b62ee8-86ba-4c65-a753-39d7d038c9fd was qcow2, converting to raw {{(pid=83806) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:33 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 Apr 29 10:37:33 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Acquiring lock "cinder-d40a6c1d-601c-4335-9015-857df528fd49-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Lock "cinder-d40a6c1d-601c-4335-9015-857df528fd49-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Acquiring lock "cinder-quobyte-d40a6c1d-601c-4335-9015-857df528fd49" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Lock "cinder-quobyte-d40a6c1d-601c-4335-9015-857df528fd49" acquired by "delete_volume" :: waited 0.040s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cda7ae-af35-4b3e-9b44-7d0be5548bf4]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:33 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49 Apr 29 10:37:33 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:33 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.872s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:34 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4" returned: 0 in 1.223s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:34 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4 Apr 29 10:37:34 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:34 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.9b069ba5-795a-46ee-af75-db90b79951c4" returned: 0 in 0.683s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-9b069ba5-795a-46ee-af75-db90b79951c4" released by "_delete_snapshot" :: held 3.783s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:34 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49" returned: 0 in 1.075s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" released by "delete_snapshot" :: held 3.824s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:34 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49 Apr 29 10:37:34 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:34 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Created reservations ['a0fb305d-7757-43d9-bbdd-613b4ac81b94', 'ddffc8d3-3c9b-45b8-a3c0-24dedb637eea', '9e17f76f-656c-47eb-bef7-18668d79c411', '7ddfe2db-0fa1-4655-857a-30dc2a080671'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:35 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Delete snapshot completed successfully. Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d1f07227-9b35-4040-b5e6-d880cb020946 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-9b069ba5-795a-46ee-af75-db90b79951c4-delete_snapshot" released by "delete_snapshot" :: held 4.006s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-62454cc3-27bf-49b1-b60e-ff58159f7216-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-62454cc3-27bf-49b1-b60e-ff58159f7216-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-quobyte-62454cc3-27bf-49b1-b60e-ff58159f7216" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-62454cc3-27bf-49b1-b60e-ff58159f7216" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Deleting offline snapshot 62454cc3-27bf-49b1-b60e-ff58159f7216 of volume d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] snapshot_file for this snap is: volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d44ca2b-55a9-4201-aa19-69f6fdbc650c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:35 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d40a6c1d-601c-4335-9015-857df528fd49" returned: 0 in 0.778s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:35 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 Apr 29 10:37:35 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Lock "cinder-quobyte-d40a6c1d-601c-4335-9015-857df528fd49" released by "delete_volume" :: held 1.909s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:35 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276" returned: 0 in 2.405s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_5ltdyd7xdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:37:35 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Converted 112.00 MB image at 46.54 MB/s Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:35 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 1G Apr 29 10:37:35 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Created reservations ['3c51c057-4010-429b-b9da-834ab6be2f88', 'c0846643-51e2-4aa3-93cd-d2ad67c28171', 'b5804bb0-1871-4b2c-97a4-c2068acbcae0', '9c4e4f8b-508f-45dd-8f31-847d69fe8085'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:35 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:35 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:36 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.714s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:36 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:36 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Deleted volume successfully. Apr 29 10:37:36 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216" returned: 0 in 1.067s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91b3892-1f44-4690-941a-c00f7bac3b50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:37:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0c1cc42e-3d7a-4420-a831-4021ce07bb34 tempest-VolumesTransfersV357Test-1508743279 None] Lock "cinder-d40a6c1d-601c-4335-9015-857df528fd49-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:36 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb25913e-1c6b-440f-85da-b747ff426fa0]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:36 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 1G" returned: 0 in 1.014s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:36 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca Apr 29 10:37:36 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:36 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abd386b-d088-4862-a8cd-839e6fafe371]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:36 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 Apr 29 10:37:36 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Flow 'volume_create_manager' (e0aeee62-b922-4656-8b06-674244f5f5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca079da3-bda7-42bb-9450-c4123a0d1876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca079da3-bda7-42bb-9450-c4123a0d1876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-147108431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e19d91-5164-4822-ab9a-347918c0738c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43dacdc436b84afc941dfce68850b76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:37Z,use_quota=True,user_id='3fcc4eb95e194fc59465c7ebceee22e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc790f62-6550-4d32-a349-36d5b306f4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc790f62-6550-4d32-a349-36d5b306f4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5b3e91-cf3a-487e-8876-301a6a68ac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5b3e91-cf3a-487e-8876-301a6a68ac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e19d91-5164-4822-ab9a-347918c0738c', 'volume_name': 'volume-40e19d91-5164-4822-ab9a-347918c0738c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7a45a2-01ac-48c7-a52a-e4887bd175bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7a45a2-01ac-48c7-a52a-e4887bd175bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624853e8-c589-4af2-a69d-287c765aa7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:37 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Volume 40e19d91-5164-4822-ab9a-347918c0738c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e19d91-5164-4822-ab9a-347918c0738c', 'volume_size': 1} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-147108431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e19d91-5164-4822-ab9a-347918c0738c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43dacdc436b84afc941dfce68850b76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:37Z,use_quota=True,user_id='3fcc4eb95e194fc59465c7ebceee22e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Creating volume 40e19d91-5164-4822-ab9a-347918c0738c {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:37 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:37 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c 1073741824 Apr 29 10:37:37 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:37 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca" returned: 0 in 0.884s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91b3892-1f44-4690-941a-c00f7bac3b50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:37 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 Apr 29 10:37:37 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:37 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276" returned: 0 in 0.842s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:37 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 Apr 29 10:37:37 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:38 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c 1073741824" returned: 0 in 1.032s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:38 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c Apr 29 10:37:38 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:38 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:38 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216" returned: 0 in 0.956s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276" returned: 1 in 0.862s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Downloaded image 79b62ee8-86ba-4c65-a753-39d7d038c9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}])) to volume f10a10f3-3e30-4485-ae58-b5fcfa1e3276 successfully. {{(pid=83806) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Temporary image 79b62ee8-86ba-4c65-a753-39d7d038c9fd for user 5415c39b3a584f5bb24b3657a980730b is deleted. {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Marking volume f10a10f3-3e30-4485-ae58-b5fcfa1e3276 as bootable. {{(pid=83806) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 10:37:38 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216 Apr 29 10:37:38 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Copying metadata from image 79b62ee8-86ba-4c65-a753-39d7d038c9fd to f10a10f3-3e30-4485-ae58-b5fcfa1e3276. {{(pid=83806) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Creating volume glance metadata for volume f10a10f3-3e30-4485-ae58-b5fcfa1e3276 backed by image 79b62ee8-86ba-4c65-a753-39d7d038c9fd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83806) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db02c823-c483-4322-be70-0d0e40d798ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edcb77d-0ac1-49f7-be6d-e89b9ff1b67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:38 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Volume volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 (f10a10f3-3e30-4485-ae58-b5fcfa1e3276): created successfully Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edcb77d-0ac1-49f7-be6d-e89b9ff1b67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:38 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (de7f534e-566f-418e-bbb0-0a4a43b923a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:38 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e9c85c75-c066-47c5-a858-7af971caa403 tempest-VolumesGetTest-1234097105 None] Created volume successfully. Apr 29 10:37:39 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c" returned: 0 in 0.674s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624853e8-c589-4af2-a69d-287c765aa7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e19d91-5164-4822-ab9a-347918c0738c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (247aa544-f958-474d-a95c-77531e4f6c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:39 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Volume volume-40e19d91-5164-4822-ab9a-347918c0738c (40e19d91-5164-4822-ab9a-347918c0738c): created successfully Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (247aa544-f958-474d-a95c-77531e4f6c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Flow 'volume_create_manager' (e0aeee62-b922-4656-8b06-674244f5f5bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:39 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f2a6b839-2c62-4340-a99f-82cff5521b78 tempest-VolumesServicesTestJSON-745746469 None] Created volume successfully. Apr 29 10:37:39 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.62454cc3-27bf-49b1-b60e-ff58159f7216" returned: 0 in 0.813s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-62454cc3-27bf-49b1-b60e-ff58159f7216" released by "_delete_snapshot" :: held 3.880s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" released by "delete_snapshot" :: held 3.910s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Created reservations ['fe0c4ebe-a310-4fc4-bfb2-0659e8079ea2', '6a3ea8de-0e36-4951-b92d-31a359ed07fe', '9e4d8679-4b33-41aa-a198-fe9e49008daa', 'bd85ce5d-18fb-472c-b0b9-ef10ad833004'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:39 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Delete snapshot completed successfully. Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d86309df-2e3f-49d2-ad70-72cb87e4040f tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-62454cc3-27bf-49b1-b60e-ff58159f7216-delete_snapshot" released by "delete_snapshot" :: held 4.149s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Acquiring lock "cinder-40e19d91-5164-4822-ab9a-347918c0738c-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Lock "cinder-40e19d91-5164-4822-ab9a-347918c0738c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Acquiring lock "cinder-quobyte-40e19d91-5164-4822-ab9a-347918c0738c" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Lock "cinder-quobyte-40e19d91-5164-4822-ab9a-347918c0738c" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[3633a09c-b199-4e38-9e90-88404dd09f07]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:39 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c Apr 29 10:37:39 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-quobyte-24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Deleting offline snapshot 24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca of volume d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] snapshot_file for this snap is: volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a563e2f3-b8c4-48c3-a3ab-85cfadaa6d0a]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:40 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca Apr 29 10:37:40 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:40 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c" returned: 0 in 0.953s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:40 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c Apr 29 10:37:40 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:40 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (ebce1d89-f1a1-4fc1-a703-83523099f16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8de1c68-a936-4eac-83c7-e1bc6f229535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca" returned: 0 in 0.907s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91b3892-1f44-4690-941a-c00f7bac3b50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f3d260-4cb0-478e-b1b9-65a7a950c394]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8de1c68-a936-4eac-83c7-e1bc6f229535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-176905038',display_name='tempest-VolumesGetTest-Volume-292061019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82acfd6-4adf-4a4b-84c4-7f9f5147184c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:41Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310c8ce9-03b7-45da-bdfe-3b23d7553440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310c8ce9-03b7-45da-bdfe-3b23d7553440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb25971-bd22-4d09-9fd0-ce26ef411372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb25971-bd22-4d09-9fd0-ce26ef411372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b82acfd6-4adf-4a4b-84c4-7f9f5147184c', 'volume_name': 'volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b276a71-2e02-4178-9a50-dc13bd5e8d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b276a71-2e02-4178-9a50-dc13bd5e8d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6b3b4c-76c6-45b8-93da-c6dc1bc33c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:40 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Volume b82acfd6-4adf-4a4b-84c4-7f9f5147184c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c', 'volume_size': 1} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-176905038',display_name='tempest-VolumesGetTest-Volume-292061019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82acfd6-4adf-4a4b-84c4-7f9f5147184c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b93b152ffaa43afa876492e9545cc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:41Z,use_quota=True,user_id='5415c39b3a584f5bb24b3657a980730b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Creating volume b82acfd6-4adf-4a4b-84c4-7f9f5147184c {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:40 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:40 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c 1073741824 Apr 29 10:37:40 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:41 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 Apr 29 10:37:41 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:41 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-40e19d91-5164-4822-ab9a-347918c0738c" returned: 0 in 0.828s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Lock "cinder-quobyte-40e19d91-5164-4822-ab9a-347918c0738c" released by "delete_volume" :: held 1.843s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Created reservations ['203f8448-12aa-4955-a408-9f1c0529858e', '3df474ed-1567-4f56-b4aa-f2e4f56f68ab', '62605819-4e54-4bd4-adfe-cfceed27a611', '76701cb5-5abd-494b-951e-e1e44447b620'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:41 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:41 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:41 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50" returned: 0 in 0.875s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:41 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca Apr 29 10:37:41 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:41 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c 1073741824" returned: 0 in 0.943s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:41 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c Apr 29 10:37:41 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:42 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.869s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:42 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Deleted volume successfully. Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-bacd6bc5-2fbb-4b4b-ade2-efdb9a70d0c1 tempest-VolumesServicesTestJSON-745746469 None] Lock "cinder-40e19d91-5164-4822-ab9a-347918c0738c-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:42 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca" returned: 0 in 0.893s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:42 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca Apr 29 10:37:42 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:42 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c" returned: 0 in 0.886s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=133,cinder:UPDATE=173,cinder:DELETE=12,cinder:INSERT=42 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6b3b4c-76c6-45b8-93da-c6dc1bc33c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64aa1cd-94bd-4f44-8d8f-13ca162c119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:42 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Volume volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c (b82acfd6-4adf-4a4b-84c4-7f9f5147184c): created successfully Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64aa1cd-94bd-4f44-8d8f-13ca162c119a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Flow 'volume_create_manager' (ebce1d89-f1a1-4fc1-a703-83523099f16f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:42 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-14fb2a61-63d6-492f-a4f0-0b48ff575f46 tempest-VolumesGetTest-1234097105 None] Created volume successfully. Apr 29 10:37:43 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50.24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca" returned: 0 in 0.689s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca" released by "_delete_snapshot" :: held 3.524s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" released by "delete_snapshot" :: held 3.563s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Created reservations ['e329ed02-0888-4711-9514-cd66cdf0c71c', '972aee19-3585-4509-8ca7-8c75219262d7', 'f95825ad-96d4-4a53-a1b7-20286082545b', 'dcaf38fd-d434-4439-a673-9e33856428c2'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:43 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Delete snapshot completed successfully. Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-082a1d63-74ae-4891-8e34-ed1c5dfc5920 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-24fc2ce7-4d0c-4d8c-bbf0-8340dc15d8ca-delete_snapshot" released by "delete_snapshot" :: held 3.743s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Flow 'volume_create_manager' (aaaeab3b-1bb5-4dfc-903d-8659db04c74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e15994-7791-490b-b212-11f3d2b8eae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e15994-7791-490b-b212-11f3d2b8eae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-482124250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd10cde-4928-4419-a7cd-c731dd143c86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b004defa5f6b45c89692fcaa931e0367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:44Z,use_quota=True,user_id='189bc23a6d03481db9c7b99ec817fd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bc9620-4025-4b54-b32b-1754342a3301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bc9620-4025-4b54-b32b-1754342a3301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccac17b-9af4-4070-982d-a8c966e11b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccac17b-9af4-4070-982d-a8c966e11b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd10cde-4928-4419-a7cd-c731dd143c86', 'volume_name': 'volume-7fd10cde-4928-4419-a7cd-c731dd143c86', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2babeac9-3426-44e1-ad32-c92d49eec981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2babeac9-3426-44e1-ad32-c92d49eec981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e8ca40-c601-4796-a3a8-7d1010b0e5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:43 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Volume 7fd10cde-4928-4419-a7cd-c731dd143c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd10cde-4928-4419-a7cd-c731dd143c86', 'volume_size': 1} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-482124250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd10cde-4928-4419-a7cd-c731dd143c86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b004defa5f6b45c89692fcaa931e0367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:44Z,use_quota=True,user_id='189bc23a6d03481db9c7b99ec817fd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Creating volume 7fd10cde-4928-4419-a7cd-c731dd143c86 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:43 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:43 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86 1073741824 Apr 29 10:37:43 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-b82acfd6-4adf-4a4b-84c4-7f9f5147184c-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Lock "cinder-b82acfd6-4adf-4a4b-84c4-7f9f5147184c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-d91b3892-1f44-4690-941a-c00f7bac3b50-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-d91b3892-1f44-4690-941a-c00f7bac3b50-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-quobyte-b82acfd6-4adf-4a4b-84c4-7f9f5147184c" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-b82acfd6-4adf-4a4b-84c4-7f9f5147184c" acquired by "delete_volume" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[511603a6-56e1-4687-8a07-efa65af9c5ab]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" acquired by "delete_volume" :: waited 0.034s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[085ef0ab-4aae-4a35-96ea-7da32b5d941f]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:44 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c Apr 29 10:37:44 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:44 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 Apr 29 10:37:44 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:44 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86 1073741824" returned: 0 in 1.058s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:44 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86 Apr 29 10:37:44 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:45 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c" returned: 0 in 0.825s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:45 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c Apr 29 10:37:45 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:45 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50" returned: 0 in 1.023s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:45 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50 Apr 29 10:37:45 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:45 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86" returned: 0 in 0.753s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e8ca40-c601-4796-a3a8-7d1010b0e5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd10cde-4928-4419-a7cd-c731dd143c86', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4554fff-d60e-496e-a9f2-e1b2cac133be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:45 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Volume volume-7fd10cde-4928-4419-a7cd-c731dd143c86 (7fd10cde-4928-4419-a7cd-c731dd143c86): created successfully Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4554fff-d60e-496e-a9f2-e1b2cac133be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Flow 'volume_create_manager' (aaaeab3b-1bb5-4dfc-903d-8659db04c74b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:45 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-cb2bf7a3-1c93-482c-87e0-3dbfea77df42 tempest-VolumesListTestJSON-189759001 None] Created volume successfully. Apr 29 10:37:45 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b82acfd6-4adf-4a4b-84c4-7f9f5147184c" returned: 0 in 0.802s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-b82acfd6-4adf-4a4b-84c4-7f9f5147184c" released by "delete_volume" :: held 1.691s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:45 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Created reservations ['22d28cda-5d84-4bc2-b43d-f42ed5fdc97c', '5a0ae7d9-7a6f-46a9-9d75-f781ba3efeef', '71e94202-66a1-4b82-898d-16832a9111db', 'a6f528a3-cbcf-4a08-ba02-15e9a79e3913'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:46 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d91b3892-1f44-4690-941a-c00f7bac3b50" returned: 0 in 0.657s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-quobyte-d91b3892-1f44-4690-941a-c00f7bac3b50" released by "delete_volume" :: held 1.769s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:46 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:46 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Created reservations ['c3fbc84e-8b84-408a-9e0a-44e52023dee4', 'a8991d49-1578-4410-944f-a6d5d3b2c42f', '4cccabea-444d-4a67-8258-ee017a66441f', '3e5e75f6-75b5-42a6-86dd-b778f139dfa6'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:46 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:46 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Flow 'volume_create_manager' (f1ed65d0-ad5a-4fdc-9c95-0ef65bdc1291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c90b3e-0bc5-42bf-953d-79350442f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c90b3e-0bc5-42bf-953d-79350442f99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1532832468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb109c6-1b9b-4033-a610-39818861ca51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b004defa5f6b45c89692fcaa931e0367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:46Z,use_quota=True,user_id='189bc23a6d03481db9c7b99ec817fd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5297220-99ec-4f47-8899-e2e97184c17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5297220-99ec-4f47-8899-e2e97184c17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ef3630-f836-4ead-a3c9-ac8d5ed7632b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ef3630-f836-4ead-a3c9-ac8d5ed7632b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb109c6-1b9b-4033-a610-39818861ca51', 'volume_name': 'volume-bcb109c6-1b9b-4033-a610-39818861ca51', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65c9766-2269-45cc-a2cc-849861332878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65c9766-2269-45cc-a2cc-849861332878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee97f50e-e5e5-4b8b-a382-b8a27621ec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:46 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Volume bcb109c6-1b9b-4033-a610-39818861ca51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb109c6-1b9b-4033-a610-39818861ca51', 'volume_size': 1} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1532832468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb109c6-1b9b-4033-a610-39818861ca51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b004defa5f6b45c89692fcaa931e0367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:46Z,use_quota=True,user_id='189bc23a6d03481db9c7b99ec817fd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Creating volume bcb109c6-1b9b-4033-a610-39818861ca51 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:46 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:46 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51 1073741824 Apr 29 10:37:46 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-f10a10f3-3e30-4485-ae58-b5fcfa1e3276-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Lock "cinder-f10a10f3-3e30-4485-ae58-b5fcfa1e3276-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Acquiring lock "cinder-quobyte-f10a10f3-3e30-4485-ae58-b5fcfa1e3276" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-f10a10f3-3e30-4485-ae58-b5fcfa1e3276" acquired by "delete_volume" :: waited 0.032s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db354db-2dcf-4e9c-9274-f70385ff17c2]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:47 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.915s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:47 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:47 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Deleted volume successfully. Apr 29 10:37:47 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 Apr 29 10:37:47 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce1c6309-2a15-41a1-8f95-998ff77be191 tempest-VolumesGetTest-1234097105 None] Lock "cinder-b82acfd6-4adf-4a4b-84c4-7f9f5147184c-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:47 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.132s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:47 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:47 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Deleted volume successfully. Apr 29 10:37:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6a87c594-d73f-49ef-ad74-3857ee55fb85 tempest-VolumesSnapshotListTestJSON-1249411918 None] Lock "cinder-d91b3892-1f44-4690-941a-c00f7bac3b50-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:48 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51 1073741824" returned: 0 in 1.417s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:48 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51 Apr 29 10:37:48 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:48 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276" returned: 0 in 1.273s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:48 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 Apr 29 10:37:48 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:48 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51" returned: 0 in 0.917s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] <== create_volume: return (2405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.411s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee97f50e-e5e5-4b8b-a382-b8a27621ec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb109c6-1b9b-4033-a610-39818861ca51', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3620ea-fee1-41b2-8c49-de4e0c639ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:49 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Volume volume-bcb109c6-1b9b-4033-a610-39818861ca51 (bcb109c6-1b9b-4033-a610-39818861ca51): created successfully Apr 29 10:37:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3620ea-fee1-41b2-8c49-de4e0c639ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Flow 'volume_create_manager' (f1ed65d0-ad5a-4fdc-9c95-0ef65bdc1291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:49 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e3217edf-119b-486a-b32e-8894c7ec7a0d tempest-VolumesListTestJSON-189759001 None] Created volume successfully. Apr 29 10:37:49 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276" returned: 1 in 1.028s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:37:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:49 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276 Apr 29 10:37:49 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:49 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f10a10f3-3e30-4485-ae58-b5fcfa1e3276" returned: 0 in 0.695s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Lock "cinder-quobyte-f10a10f3-3e30-4485-ae58-b5fcfa1e3276" released by "delete_volume" :: held 3.121s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:49 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Created reservations ['8ddf3666-233d-48eb-9c4d-ec1b3902529a', '3e10780e-2fda-42d7-aa6a-4b7cb47bca52', 'a3728ce2-2587-40da-adf7-287d1c694700', '5cc4c271-31eb-48e9-9d39-2d310aa5ed0a'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:50 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:50 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Flow 'volume_create_manager' (4c5778c2-1cc9-4129-8328-81154ffd6f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b40d150-6cfc-46aa-8bed-9c265498a826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b40d150-6cfc-46aa-8bed-9c265498a826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1562376863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607a518a-23f4-4907-baef-3a26ce9f9fc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b004defa5f6b45c89692fcaa931e0367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:50Z,use_quota=True,user_id='189bc23a6d03481db9c7b99ec817fd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7816cc7-9601-44f3-939e-55fa7c21d76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7816cc7-9601-44f3-939e-55fa7c21d76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afce0e48-8988-47bb-bcdd-8c751c1a4f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afce0e48-8988-47bb-bcdd-8c751c1a4f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '607a518a-23f4-4907-baef-3a26ce9f9fc4', 'volume_name': 'volume-607a518a-23f4-4907-baef-3a26ce9f9fc4', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386c39db-1ec1-481d-996b-c476b708c81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386c39db-1ec1-481d-996b-c476b708c81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b508099-8a01-414d-b179-db82b86b8033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:50 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Volume 607a518a-23f4-4907-baef-3a26ce9f9fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-607a518a-23f4-4907-baef-3a26ce9f9fc4', 'volume_size': 1} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1562376863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607a518a-23f4-4907-baef-3a26ce9f9fc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b004defa5f6b45c89692fcaa931e0367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:50Z,use_quota=True,user_id='189bc23a6d03481db9c7b99ec817fd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Creating volume 607a518a-23f4-4907-baef-3a26ce9f9fc4 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:50 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:50 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4 1073741824 Apr 29 10:37:50 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:50 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.725s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:50 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Deleted volume successfully. Apr 29 10:37:50 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6d9f1186-9f7d-4e8f-a987-55d31797778c tempest-VolumesGetTest-1234097105 None] Lock "cinder-f10a10f3-3e30-4485-ae58-b5fcfa1e3276-delete_volume" released by "delete_volume" :: held 4.157s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Flow 'volume_create_manager' (4e1cc159-8487-4b62-ad10-14459e749539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8b7863-f50e-44b1-983e-bbee191b74f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8b7863-f50e-44b1-983e-bbee191b74f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-940814481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932a65b210df4de7b5b17441b75fdbb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:51Z,use_quota=True,user_id='ab8528477f36475ca67912745bb70a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf72d1f-0d4d-4cde-9697-ccaf137ae0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf72d1f-0d4d-4cde-9697-ccaf137ae0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbdad4f-b90b-47f7-83bb-b176ad0aa0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbdad4f-b90b-47f7-83bb-b176ad0aa0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b', 'volume_name': 'volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b', 'volume_size': 2}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6158d9-b427-43a4-98b8-51b63f07560b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6158d9-b427-43a4-98b8-51b63f07560b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31a0440-8361-4263-83af-285cce869a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:51 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Volume 8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b', 'volume_size': 2} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:51 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4 1073741824" returned: 0 in 1.063s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:51 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4 Apr 29 10:37:51 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:52 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4" returned: 0 in 0.656s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-940814481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='932a65b210df4de7b5b17441b75fdbb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:51Z,use_quota=True,user_id='ab8528477f36475ca67912745bb70a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Creating volume 8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:52 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b 2147483648 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:52 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b 2147483648 Apr 29 10:37:52 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b508099-8a01-414d-b179-db82b86b8033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-607a518a-23f4-4907-baef-3a26ce9f9fc4', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2be298-e333-4079-af48-4e74599dccab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:52 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Volume volume-607a518a-23f4-4907-baef-3a26ce9f9fc4 (607a518a-23f4-4907-baef-3a26ce9f9fc4): created successfully Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2be298-e333-4079-af48-4e74599dccab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Flow 'volume_create_manager' (4c5778c2-1cc9-4129-8328-81154ffd6f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:52 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5f3870ea-a46e-404d-b5bd-21ede9de8624 tempest-VolumesListTestJSON-189759001 None] Created volume successfully. Apr 29 10:37:53 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b 2147483648" returned: 0 in 1.179s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:53 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b Apr 29 10:37:53 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:54 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" returned: 0 in 0.754s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31a0440-8361-4263-83af-285cce869a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b', 'volume_size': 2}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96279d7-8e9b-4edf-961a-97da22f64f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:54 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Volume volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b (8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b): created successfully Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96279d7-8e9b-4edf-961a-97da22f64f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Flow 'volume_create_manager' (4e1cc159-8487-4b62-ad10-14459e749539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:54 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e1bbfd0d-cbec-41ce-a6d1-0e8dc63e9401 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Created volume successfully. Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Creating offline snapshot 3c33e480-2bb3-44bb-9510-f70126135fa2 of volume 8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bce894-52d3-4854-ae1c-7b85191c4779]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Flow 'volume_create_manager' (482ad2ad-f54c-45ee-a722-4954612aabf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:55 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b Apr 29 10:37:55 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080c938e-4234-4309-972c-b25aaee312a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080c938e-4234-4309-972c-b25aaee312a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-712970270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc71afd-e372-4f75-9b4d-bd5e1abad093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9dd38a208274e18a75693082e9ffb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:55Z,use_quota=True,user_id='4f743a083a30439f879eaec311e58e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601adfd5-300b-4829-965d-3982aafc44d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601adfd5-300b-4829-965d-3982aafc44d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b261e9a0-1ec9-476b-9273-b3927b6462cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b261e9a0-1ec9-476b-9273-b3927b6462cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abc71afd-e372-4f75-9b4d-bd5e1abad093', 'volume_name': 'volume-abc71afd-e372-4f75-9b4d-bd5e1abad093', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44dacd1-8cc6-4662-99bc-d23d0d8e7c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44dacd1-8cc6-4662-99bc-d23d0d8e7c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e53f569-4786-4c75-ad46-7630e327cf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:55 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Volume abc71afd-e372-4f75-9b4d-bd5e1abad093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abc71afd-e372-4f75-9b4d-bd5e1abad093', 'volume_size': 1} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Acquiring lock "cinder-607a518a-23f4-4907-baef-3a26ce9f9fc4-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Lock "cinder-607a518a-23f4-4907-baef-3a26ce9f9fc4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Acquiring lock "cinder-quobyte-607a518a-23f4-4907-baef-3a26ce9f9fc4" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Lock "cinder-quobyte-607a518a-23f4-4907-baef-3a26ce9f9fc4" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[2859b189-6c51-4bfc-9946-dce535286628]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:55 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4 Apr 29 10:37:55 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Flow 'volume_create_manager' (6b8d837f-0cd8-4cba-a594-41f019af4a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:37:55 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff4980d-c805-4d8f-88af-07be1556de8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" returned: 0 in 0.880s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 2G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:55 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 2G Apr 29 10:37:55 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff4980d-c805-4d8f-88af-07be1556de8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-230937951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0f85d4-c70f-4e22-8739-37d9f00fb0e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9892d53d0f4246a39d303a349520c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:56Z,use_quota=True,user_id='a5381a1ec7be467696b139b4653dcff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6547b6e-55c2-4009-84cb-9f4fda50ce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6547b6e-55c2-4009-84cb-9f4fda50ce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c11fdd-df32-4f6e-bb8d-f910673e3e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c11fdd-df32-4f6e-bb8d-f910673e3e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0f85d4-c70f-4e22-8739-37d9f00fb0e8', 'volume_name': 'volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f431e13f-a99e-45d0-9619-e864ae596096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f431e13f-a99e-45d0-9619-e864ae596096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68729bf1-30f4-40fd-bb67-6d844aa011fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:37:55 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Volume fa0f85d4-c70f-4e22-8739-37d9f00fb0e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8', 'volume_size': 1} Apr 29 10:37:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:56 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4" returned: 0 in 0.715s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:56 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4 Apr 29 10:37:56 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:56 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 2G" returned: 0 in 0.747s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:56 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 Apr 29 10:37:56 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:56 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-607a518a-23f4-4907-baef-3a26ce9f9fc4" returned: 0 in 0.644s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Lock "cinder-quobyte-607a518a-23f4-4907-baef-3a26ce9f9fc4" released by "delete_volume" :: held 1.412s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:56 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Created reservations ['8240bea5-eddd-48c3-a82f-056c5406d26d', '8ac08980-aa20-44c9-947f-dd52d2d18b11', '7bcfcf33-a2b0-4f90-838d-216197cf3bf3', '2856536a-99d5-4538-9840-d95d1c97abda'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:57 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:57 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:57 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2" returned: 0 in 0.661s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:57 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 is being set with open permissions: ugo+rw Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:57 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 Apr 29 10:37:57 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Acquiring lock "cinder-bcb109c6-1b9b-4033-a610-39818861ca51-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Lock "cinder-bcb109c6-1b9b-4033-a610-39818861ca51-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:57 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.706s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:57 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Deleted volume successfully. Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Acquiring lock "cinder-quobyte-bcb109c6-1b9b-4033-a610-39818861ca51" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Lock "cinder-quobyte-bcb109c6-1b9b-4033-a610-39818861ca51" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-daab2880-ba21-40f6-95a8-b529e8613840 tempest-VolumesListTestJSON-189759001 None] Lock "cinder-607a518a-23f4-4907-baef-3a26ce9f9fc4-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[299fdd46-e246-4d0d-bba6-14d220f3f9b6]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:57 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2" returned: 0 in 0.717s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:57 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51 Apr 29 10:37:57 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:57 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.info Apr 29 10:37:57 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:58 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51" returned: 0 in 0.696s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:58 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51 Apr 29 10:37:58 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:58 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.info" returned: 0 in 0.678s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:58 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.info is being set with open permissions: ugo+rw Apr 29 10:37:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:58 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.info Apr 29 10:37:58 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:59 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.info" returned: 0 in 0.568s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.376s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:59 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.067s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-712970270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc71afd-e372-4f75-9b4d-bd5e1abad093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9dd38a208274e18a75693082e9ffb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:55Z,use_quota=True,user_id='4f743a083a30439f879eaec311e58e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Creating volume abc71afd-e372-4f75-9b4d-bd5e1abad093 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:37:59 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bcb109c6-1b9b-4033-a610-39818861ca51" returned: 0 in 0.715s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:59 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093 1073741824 Apr 29 10:37:59 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Lock "cinder-quobyte-bcb109c6-1b9b-4033-a610-39818861ca51" released by "delete_volume" :: held 1.468s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:37:59 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d6aec456-49fe-48c1-a47d-667c3bc6b71f tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Create snapshot completed successfully Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Created reservations ['a41aa617-8df8-4f33-b776-9521dcd0d491', 'd506956f-e62b-4742-8978-d8e42f4e4e23', '0fa0095b-0094-45f2-9371-7fa28a67b98a', 'e0a6b75b-7f19-49e6-8cec-eca357c4a3fd'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:37:59 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:37:59 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:37:59 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.584s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:37:59 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:37:59 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Deleted volume successfully. Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-40673b89-600f-4339-ac09-66e87bda62f8 tempest-VolumesListTestJSON-189759001 None] Lock "cinder-bcb109c6-1b9b-4033-a610-39818861ca51-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Acquiring lock "cinder-7fd10cde-4928-4419-a7cd-c731dd143c86-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Lock "cinder-7fd10cde-4928-4419-a7cd-c731dd143c86-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Acquiring lock "cinder-quobyte-7fd10cde-4928-4419-a7cd-c731dd143c86" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Lock "cinder-quobyte-7fd10cde-4928-4419-a7cd-c731dd143c86" acquired by "delete_volume" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f3ce2b-43ab-4e64-aa5c-34b4a5733bff]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Acquiring lock "cinder-3c33e480-2bb3-44bb-9510-f70126135fa2-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:00 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093 1073741824" returned: 0 in 0.986s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "cinder-3c33e480-2bb3-44bb-9510-f70126135fa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Acquiring lock "cinder-quobyte-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "cinder-quobyte-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Acquiring lock "cinder-quobyte-3c33e480-2bb3-44bb-9510-f70126135fa2" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "cinder-quobyte-3c33e480-2bb3-44bb-9510-f70126135fa2" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Deleting offline snapshot 3c33e480-2bb3-44bb-9510-f70126135fa2 of volume 8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:38:00 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093 Apr 29 10:38:00 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] snapshot_file for this snap is: volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:38:00 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86 Apr 29 10:38:00 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[876d0fd4-a522-4a62-be84-0ddb699f8125]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:00 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 Apr 29 10:38:00 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:00 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86" returned: 0 in 0.748s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:00 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86 Apr 29 10:38:00 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:01 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093" returned: 0 in 0.727s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.183s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-230937951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0f85d4-c70f-4e22-8739-37d9f00fb0e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9892d53d0f4246a39d303a349520c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:37:56Z,use_quota=True,user_id='a5381a1ec7be467696b139b4653dcff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Creating volume fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:01 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e53f569-4786-4c75-ad46-7630e327cf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc71afd-e372-4f75-9b4d-bd5e1abad093', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:01 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0d0b0b-0b18-4d6e-ac38-ae3a6133448b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:01 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 1073741824 Apr 29 10:38:01 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2" returned: 0 in 0.709s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:38:01 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Volume volume-abc71afd-e372-4f75-9b4d-bd5e1abad093 (abc71afd-e372-4f75-9b4d-bd5e1abad093): created successfully Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0d0b0b-0b18-4d6e-ac38-ae3a6133448b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Flow 'volume_create_manager' (482ad2ad-f54c-45ee-a722-4954612aabf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbe678a-ac3d-4295-8302-27f138725589]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:01 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-fca54287-e395-41b3-9de8-a1a68ea5c1e2 tempest-VolumesNegativeTest-1761904376 None] Created volume successfully. Apr 29 10:38:01 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b Apr 29 10:38:01 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:01 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fd10cde-4928-4419-a7cd-c731dd143c86" returned: 0 in 0.735s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Lock "cinder-quobyte-7fd10cde-4928-4419-a7cd-c731dd143c86" released by "delete_volume" :: held 1.538s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Created reservations ['ca4f8309-95e7-482f-8156-8b860986f751', 'ea0c8a37-3661-410c-80f2-8489d73d3967', '13650b32-f6c3-469d-b453-93142901fcb4', '11896036-ae37-43a2-afa0-b2237ec5eaf3'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:01 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:01 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:02 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 1073741824" returned: 0 in 0.953s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:02 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" returned: 0 in 0.888s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:02 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 Apr 29 10:38:02 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:02 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 Apr 29 10:38:02 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:02 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.933s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:02 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:02 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Deleted volume successfully. Apr 29 10:38:02 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c7e3a06f-27d8-4394-9ce9-2b9cb82a572e tempest-VolumesListTestJSON-189759001 None] Lock "cinder-7fd10cde-4928-4419-a7cd-c731dd143c86-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:03 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2" returned: 0 in 0.992s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:03 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2 Apr 29 10:38:03 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:03 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8" returned: 0 in 1.041s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68729bf1-30f4-40fd-bb67-6d844aa011fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8fb2e2-bfa4-4410-899f-bf2a9fbe02a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:03 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Volume volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 (fa0f85d4-c70f-4e22-8739-37d9f00fb0e8): created successfully Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8fb2e2-bfa4-4410-899f-bf2a9fbe02a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Flow 'volume_create_manager' (6b8d837f-0cd8-4cba-a594-41f019af4a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:03 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-1539bc00-e1c8-45de-bf98-6a66182f89dd tempest-VolumesListAdminTestJSON-1806628532 None] Created volume successfully. Apr 29 10:38:03 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b.3c33e480-2bb3-44bb-9510-f70126135fa2" returned: 0 in 0.841s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Flow 'volume_create_manager' (58429e01-48f9-40b2-a1d1-c7c0071ce197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd9bec7-2b88-4c9d-83fe-857e36e6e20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "cinder-quobyte-3c33e480-2bb3-44bb-9510-f70126135fa2" released by "_delete_snapshot" :: held 3.611s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd9bec7-2b88-4c9d-83fe-857e36e6e20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1879461574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db1cbe5-a9f8-42d1-a6a3-ead300abcd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9892d53d0f4246a39d303a349520c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:04Z,use_quota=True,user_id='a5381a1ec7be467696b139b4653dcff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3341d446-fea4-406e-b67d-48ecbaad149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3341d446-fea4-406e-b67d-48ecbaad149d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467be234-9bda-4caf-8a4c-46dee7be5954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467be234-9bda-4caf-8a4c-46dee7be5954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db1cbe5-a9f8-42d1-a6a3-ead300abcd63', 'volume_name': 'volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca5d243-8dfb-449a-96f2-c812df96b1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca5d243-8dfb-449a-96f2-c812df96b1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae807fa-9f7c-4127-bbfc-cc4274b0101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:03 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Volume 6db1cbe5-a9f8-42d1-a6a3-ead300abcd63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63', 'volume_size': 1} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1879461574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db1cbe5-a9f8-42d1-a6a3-ead300abcd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9892d53d0f4246a39d303a349520c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:04Z,use_quota=True,user_id='a5381a1ec7be467696b139b4653dcff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Creating volume 6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:04 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "cinder-quobyte-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" released by "delete_snapshot" :: held 3.727s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:04 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 1073741824 Apr 29 10:38:04 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Created reservations ['6b41d89c-8c3d-487e-ba87-963164a432fa', 'fc6c8169-4acd-4e2c-ab18-4b3d47a86b41', '10d0e9ef-fa01-4997-9b5f-ec4c98881be2', '98edd28e-a9ca-4756-bc1b-1e95fa79f2b7'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:04 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Delete snapshot completed successfully. Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7602af06-5a7e-4ca9-81bc-54ef0958fbd4 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "cinder-3c33e480-2bb3-44bb-9510-f70126135fa2-delete_snapshot" released by "delete_snapshot" :: held 3.928s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Acquiring lock "cinder-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "cinder-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Acquiring lock "cinder-quobyte-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "cinder-quobyte-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" acquired by "delete_volume" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed6b8e3-1de6-4ffc-b2df-0f8222ec3ac0]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:04 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b Apr 29 10:38:04 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:04 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 1073741824" returned: 0 in 0.977s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:05 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 Apr 29 10:38:05 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:05 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" returned: 0 in 0.813s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:05 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b Apr 29 10:38:05 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:05 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63" returned: 0 in 0.649s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae807fa-9f7c-4127-bbfc-cc4274b0101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177e3e18-95bf-4336-8970-913707bdfd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:05 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Volume volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 (6db1cbe5-a9f8-42d1-a6a3-ead300abcd63): created successfully Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177e3e18-95bf-4336-8970-913707bdfd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Flow 'volume_create_manager' (58429e01-48f9-40b2-a1d1-c7c0071ce197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e6b96020-fcbd-49c6-a947-775e9799397a tempest-VolumesListAdminTestJSON-1806628532 None] Created volume successfully. Apr 29 10:38:05 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Flow 'volume_create_manager' (f5d175bf-3a8c-428b-ad27-851eda5e5bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840ef5fa-3261-4500-b53f-b248f7f83c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840ef5fa-3261-4500-b53f-b248f7f83c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-666033036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73c4694-aa7c-4bb5-9385-c2694e9a8776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e5d1cb80984654945dd5cc1fdf9062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:06Z,use_quota=True,user_id='7f952af22e4e41519ee294c7b28329a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373757e4-387f-4b31-ac9e-d389bda7ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373757e4-387f-4b31-ac9e-d389bda7ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12476760-98b7-4ab3-914f-fe6f219a2c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12476760-98b7-4ab3-914f-fe6f219a2c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a73c4694-aa7c-4bb5-9385-c2694e9a8776', 'volume_name': 'volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e997c017-cac0-42da-94a0-2f22ad82ae02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e997c017-cac0-42da-94a0-2f22ad82ae02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f38811-0989-4545-8632-f2d99fa4d2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Volume a73c4694-aa7c-4bb5-9385-c2694e9a8776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776', 'volume_size': 1} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-666033036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73c4694-aa7c-4bb5-9385-c2694e9a8776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e5d1cb80984654945dd5cc1fdf9062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:06Z,use_quota=True,user_id='7f952af22e4e41519ee294c7b28329a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Creating volume a73c4694-aa7c-4bb5-9385-c2694e9a8776 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:06 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:06 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776 1073741824 Apr 29 10:38:06 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Flow 'volume_create_manager' (f6bd2b27-bb40-4c39-8fd1-2ae9977f8914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:06 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe36037-60b7-4a97-87ad-c76491d2933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" returned: 0 in 0.931s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe36037-60b7-4a97-87ad-c76491d2933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1995799215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a23b13-2c65-42d1-b236-5308e28c5a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e5d1cb80984654945dd5cc1fdf9062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:06Z,use_quota=True,user_id='7f952af22e4e41519ee294c7b28329a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f9252e-c1ee-410f-b66b-d32b2723de17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f9252e-c1ee-410f-b66b-d32b2723de17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa9191e-45b5-44dd-81a1-d65263798287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa9191e-45b5-44dd-81a1-d65263798287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a23b13-2c65-42d1-b236-5308e28c5a92', 'volume_name': 'volume-88a23b13-2c65-42d1-b236-5308e28c5a92', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77a7cde-f706-45d4-a48b-d21a85aca45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77a7cde-f706-45d4-a48b-d21a85aca45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e538fa2-6c57-43ba-844f-33d1b325487f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Volume 88a23b13-2c65-42d1-b236-5308e28c5a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a23b13-2c65-42d1-b236-5308e28c5a92', 'volume_size': 1} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "cinder-quobyte-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b" released by "delete_volume" :: held 1.883s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Created reservations ['c51b0488-4d4f-449e-a9bd-23f14bdd9ccc', 'f7439464-e0ef-4489-8eea-e2f6d97ae81c', '6ad9c7e2-b18b-4283-8a75-0b27628b582d', 'ce73f1e2-ad5d-4b97-8831-1e01258b8745'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Flow 'volume_create_manager' (c75477c9-746a-4135-b79e-75724fa1b03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5300b8-72d8-41e0-ac19-57c77059ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5300b8-72d8-41e0-ac19-57c77059ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1775616316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26d5989-fa55-49b6-b5a1-d8047db0fb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9892d53d0f4246a39d303a349520c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:07Z,use_quota=True,user_id='a5381a1ec7be467696b139b4653dcff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:07 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a648181-a336-40ee-b57c-af7276036ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a648181-a336-40ee-b57c-af7276036ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d71240-1aef-4827-b1c7-a4040c166da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d71240-1aef-4827-b1c7-a4040c166da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26d5989-fa55-49b6-b5a1-d8047db0fb77', 'volume_name': 'volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f48fe2-6bee-4378-aa2c-f8765e1d2ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f48fe2-6bee-4378-aa2c-f8765e1d2ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6026c9-8829-481b-97c4-9dc8a00537d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Volume b26d5989-fa55-49b6-b5a1-d8047db0fb77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77', 'volume_size': 1} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Flow 'volume_create_manager' (08819080-21e5-4a76-b2b2-31d24c3bc5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d50f716-7908-4d98-9bf4-30e6578b262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d50f716-7908-4d98-9bf4-30e6578b262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1204393533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230b67be-7d68-4803-9894-01ca799c9813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e5d1cb80984654945dd5cc1fdf9062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:07Z,use_quota=True,user_id='7f952af22e4e41519ee294c7b28329a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3574fb-3f5c-4d36-99d1-a63c0a5a196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3574fb-3f5c-4d36-99d1-a63c0a5a196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08716d6a-00cf-4596-9e04-4f4c6e5c5d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08716d6a-00cf-4596-9e04-4f4c6e5c5d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '230b67be-7d68-4803-9894-01ca799c9813', 'volume_name': 'volume-230b67be-7d68-4803-9894-01ca799c9813', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086cd88d-d060-4657-a65a-1698db7d0220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086cd88d-d060-4657-a65a-1698db7d0220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ec6f22-21b9-4c06-88f4-fccd8f801e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Volume 230b67be-7d68-4803-9894-01ca799c9813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-230b67be-7d68-4803-9894-01ca799c9813', 'volume_size': 1} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Flow 'volume_create_manager' (d164e51b-e193-4146-ba53-4f3c9fb4bd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c532fe2-c305-4913-ac66-6201d177b4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c532fe2-c305-4913-ac66-6201d177b4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635785055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087767ca-3822-4415-9351-3752bbfbe048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e5d1cb80984654945dd5cc1fdf9062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:07Z,use_quota=True,user_id='7f952af22e4e41519ee294c7b28329a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe3dd13-b94c-4f3d-9935-1204a1ee1e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe3dd13-b94c-4f3d-9935-1204a1ee1e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde5e58f-aa23-4ebd-a83d-2f5be2041d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde5e58f-aa23-4ebd-a83d-2f5be2041d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087767ca-3822-4415-9351-3752bbfbe048', 'volume_name': 'volume-087767ca-3822-4415-9351-3752bbfbe048', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d4b715-50f5-461f-9844-383d674f38eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d4b715-50f5-461f-9844-383d674f38eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277e0ec1-64d2-47fa-908a-98b8b8be3dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:07 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Volume 087767ca-3822-4415-9351-3752bbfbe048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087767ca-3822-4415-9351-3752bbfbe048', 'volume_size': 1} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:07 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776 1073741824" returned: 0 in 1.532s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:07 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776 Apr 29 10:38:07 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:08 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.047s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:08 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Deleted volume successfully. Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-438f2a28-db15-4993-a0de-030d66b5c7a0 tempest-VolumesSnapshotNegativeTestJSON-1781778902 None] Lock "cinder-8e0ad9c3-c7a7-4fe1-b955-7f4aa4cb547b-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Flow 'volume_create_manager' (35819194-bd29-4589-a64c-f8e3cd1dce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30434bce-4dee-4483-96fb-de07c3a08052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30434bce-4dee-4483-96fb-de07c3a08052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-737663948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63474c9-0200-4bc9-ae81-e08c452a6d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e5d1cb80984654945dd5cc1fdf9062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:08Z,use_quota=True,user_id='7f952af22e4e41519ee294c7b28329a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41322b1c-d1f7-4009-9351-cb5a3610d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41322b1c-d1f7-4009-9351-cb5a3610d655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a171b9-1809-44fb-90ec-6f0e0bb24e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a171b9-1809-44fb-90ec-6f0e0bb24e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63474c9-0200-4bc9-ae81-e08c452a6d11', 'volume_name': 'volume-b63474c9-0200-4bc9-ae81-e08c452a6d11', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15d5fa8-b521-4178-b268-d81859673749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15d5fa8-b521-4178-b268-d81859673749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283bd117-057e-4a98-a47f-30ee12ce48c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:08 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Volume b63474c9-0200-4bc9-ae81-e08c452a6d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63474c9-0200-4bc9-ae81-e08c452a6d11', 'volume_size': 1} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:08 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776" returned: 0 in 0.953s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] <== create_volume: return (2587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.590s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.083s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1995799215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a23b13-2c65-42d1-b236-5308e28c5a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e5d1cb80984654945dd5cc1fdf9062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:06Z,use_quota=True,user_id='7f952af22e4e41519ee294c7b28329a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Creating volume 88a23b13-2c65-42d1-b236-5308e28c5a92 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:08 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=203,cinder:SELECT=159,cinder:INSERT=53,cinder:DELETE=24 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:38:08 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92 1073741824 Apr 29 10:38:08 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f38811-0989-4545-8632-f2d99fa4d2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b484fd-388b-4e79-bdc7-214e67cc053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:08 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Volume volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776 (a73c4694-aa7c-4bb5-9385-c2694e9a8776): created successfully Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b484fd-388b-4e79-bdc7-214e67cc053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:08 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Flow 'volume_create_manager' (f5d175bf-3a8c-428b-ad27-851eda5e5bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:08 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-684d7df7-2bd5-4aa4-9412-5b50360b6b1b tempest-CreateVolumesFromImageTest-1178055673 None] Created volume successfully. Apr 29 10:38:09 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92 1073741824" returned: 0 in 1.059s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:09 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92 Apr 29 10:38:09 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:10 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92" returned: 0 in 0.651s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.353s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1775616316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26d5989-fa55-49b6-b5a1-d8047db0fb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9892d53d0f4246a39d303a349520c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:07Z,use_quota=True,user_id='a5381a1ec7be467696b139b4653dcff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Creating volume b26d5989-fa55-49b6-b5a1-d8047db0fb77 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:10 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e538fa2-6c57-43ba-844f-33d1b325487f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a23b13-2c65-42d1-b236-5308e28c5a92', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:10 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77 1073741824 Apr 29 10:38:10 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eec145e-c0e6-4646-bdcd-32a4d4d87700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:10 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Volume volume-88a23b13-2c65-42d1-b236-5308e28c5a92 (88a23b13-2c65-42d1-b236-5308e28c5a92): created successfully Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eec145e-c0e6-4646-bdcd-32a4d4d87700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Flow 'volume_create_manager' (f6bd2b27-bb40-4c39-8fd1-2ae9977f8914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:10 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4cf5b80e-6b34-4748-9c74-827dc4727103 tempest-CreateVolumesFromImageTest-1178055673 None] Created volume successfully. Apr 29 10:38:11 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77 1073741824" returned: 0 in 0.757s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:11 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77 Apr 29 10:38:11 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:11 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77" returned: 0 in 0.571s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.545s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1204393533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230b67be-7d68-4803-9894-01ca799c9813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e5d1cb80984654945dd5cc1fdf9062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:07Z,use_quota=True,user_id='7f952af22e4e41519ee294c7b28329a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Creating volume 230b67be-7d68-4803-9894-01ca799c9813 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:11 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:11 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813 1073741824 Apr 29 10:38:11 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6026c9-8829-481b-97c4-9dc8a00537d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12241a80-ee63-4495-8fa6-0b3e2a2c00c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:12 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Volume volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77 (b26d5989-fa55-49b6-b5a1-d8047db0fb77): created successfully Apr 29 10:38:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12241a80-ee63-4495-8fa6-0b3e2a2c00c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Flow 'volume_create_manager' (c75477c9-746a-4135-b79e-75724fa1b03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:12 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-999e8e0b-14fa-4fd1-8979-317f641e967a tempest-VolumesListAdminTestJSON-1806628532 None] Created volume successfully. Apr 29 10:38:12 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813 1073741824" returned: 0 in 0.833s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:12 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813 Apr 29 10:38:12 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Flow 'volume_create_manager' (5ccf4795-1f2d-4ea9-9f5b-a97df4da7630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ade31a-fa2a-4052-8052-b8ccdf9bfb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ade31a-fa2a-4052-8052-b8ccdf9bfb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b1239d-54ab-409a-a08d-5df5c4a14451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e777fbaa2b43ec88aa0b9d98dcd705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:13Z,use_quota=True,user_id='5fac6f4d874c4591ab0be521e7f29bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393b59a2-fe90-4924-a973-369d95dba1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393b59a2-fe90-4924-a973-369d95dba1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46348d37-5273-4768-aad8-d13d019d981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46348d37-5273-4768-aad8-d13d019d981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b1239d-54ab-409a-a08d-5df5c4a14451', 'volume_name': 'volume-58b1239d-54ab-409a-a08d-5df5c4a14451', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21f97e8-0454-4093-8860-d547e1209f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21f97e8-0454-4093-8860-d547e1209f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70132bbc-176b-4ecf-aee0-922f9b2461f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:13 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Volume 58b1239d-54ab-409a-a08d-5df5c4a14451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b1239d-54ab-409a-a08d-5df5c4a14451', 'volume_size': 1} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:13 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813" returned: 0 in 0.636s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.819s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635785055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087767ca-3822-4415-9351-3752bbfbe048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e5d1cb80984654945dd5cc1fdf9062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:07Z,use_quota=True,user_id='7f952af22e4e41519ee294c7b28329a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Creating volume 087767ca-3822-4415-9351-3752bbfbe048 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:13 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ec6f22-21b9-4c06-88f4-fccd8f801e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230b67be-7d68-4803-9894-01ca799c9813', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:13 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048 1073741824 Apr 29 10:38:13 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67dec73a-079e-460c-b32d-5df713bd7369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:13 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Volume volume-230b67be-7d68-4803-9894-01ca799c9813 (230b67be-7d68-4803-9894-01ca799c9813): created successfully Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67dec73a-079e-460c-b32d-5df713bd7369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Flow 'volume_create_manager' (08819080-21e5-4a76-b2b2-31d24c3bc5a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:13 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-812c155a-ebd7-4904-b8b2-bbbae0dbf64a tempest-CreateVolumesFromImageTest-1178055673 None] Created volume successfully. Apr 29 10:38:14 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048 1073741824" returned: 0 in 0.759s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:14 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048 Apr 29 10:38:14 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:14 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048" returned: 0 in 0.581s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.536s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-737663948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63474c9-0200-4bc9-ae81-e08c452a6d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e5d1cb80984654945dd5cc1fdf9062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:08Z,use_quota=True,user_id='7f952af22e4e41519ee294c7b28329a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Creating volume b63474c9-0200-4bc9-ae81-e08c452a6d11 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:14 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:14 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11 1073741824 Apr 29 10:38:14 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277e0ec1-64d2-47fa-908a-98b8b8be3dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087767ca-3822-4415-9351-3752bbfbe048', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cbcd34-adf2-4d0b-85bd-352df0ed1c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:14 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Volume volume-087767ca-3822-4415-9351-3752bbfbe048 (087767ca-3822-4415-9351-3752bbfbe048): created successfully Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cbcd34-adf2-4d0b-85bd-352df0ed1c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Flow 'volume_create_manager' (d164e51b-e193-4146-ba53-4f3c9fb4bd46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:14 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-84eb148c-309d-409e-96ac-8ccd84b53baf tempest-CreateVolumesFromImageTest-1178055673 None] Created volume successfully. Apr 29 10:38:15 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11 1073741824" returned: 0 in 1.225s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:16 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11 Apr 29 10:38:16 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:16 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11" returned: 0 in 0.648s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.556s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b1239d-54ab-409a-a08d-5df5c4a14451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e777fbaa2b43ec88aa0b9d98dcd705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:13Z,use_quota=True,user_id='5fac6f4d874c4591ab0be521e7f29bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Creating volume 58b1239d-54ab-409a-a08d-5df5c4a14451 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:16 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:16 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451 1073741824 Apr 29 10:38:16 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283bd117-057e-4a98-a47f-30ee12ce48c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63474c9-0200-4bc9-ae81-e08c452a6d11', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d37ef59-9b25-4504-917e-d412849ca37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:16 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Volume volume-b63474c9-0200-4bc9-ae81-e08c452a6d11 (b63474c9-0200-4bc9-ae81-e08c452a6d11): created successfully Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d37ef59-9b25-4504-917e-d412849ca37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Flow 'volume_create_manager' (35819194-bd29-4589-a64c-f8e3cd1dce3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:16 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-a3240f21-cb80-4355-be4d-001e779c69cc tempest-CreateVolumesFromImageTest-1178055673 None] Created volume successfully. Apr 29 10:38:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "cinder-b63474c9-0200-4bc9-ae81-e08c452a6d11-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-b63474c9-0200-4bc9-ae81-e08c452a6d11-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "cinder-quobyte-b63474c9-0200-4bc9-ae81-e08c452a6d11" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-quobyte-b63474c9-0200-4bc9-ae81-e08c452a6d11" acquired by "delete_volume" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:17 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa8d8ea-7778-4ac6-8151-f442d85b4bc2]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:17 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11 Apr 29 10:38:17 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:17 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451 1073741824" returned: 0 in 1.022s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:17 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451 Apr 29 10:38:17 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:18 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11" returned: 0 in 0.881s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:18 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11 Apr 29 10:38:18 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:18 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451" returned: 0 in 0.709s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70132bbc-176b-4ecf-aee0-922f9b2461f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b1239d-54ab-409a-a08d-5df5c4a14451', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc591c2f-c6eb-4cec-8bfb-bff09eab4c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:18 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Volume volume-58b1239d-54ab-409a-a08d-5df5c4a14451 (58b1239d-54ab-409a-a08d-5df5c4a14451): created successfully Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc591c2f-c6eb-4cec-8bfb-bff09eab4c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Flow 'volume_create_manager' (5ccf4795-1f2d-4ea9-9f5b-a97df4da7630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:18 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-1c56d66e-3938-42a5-bdc9-d1bf186a12c0 tempest-VolumesListAdminTestJSON-1105733465 None] Created volume successfully. Apr 29 10:38:18 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b63474c9-0200-4bc9-ae81-e08c452a6d11" returned: 0 in 0.773s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-quobyte-b63474c9-0200-4bc9-ae81-e08c452a6d11" released by "delete_volume" :: held 1.736s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Created reservations ['02071720-4302-4aeb-95d1-38d1181b1e10', 'd695a875-f240-431d-aa9a-a5c4fe01cae5', '96f64568-9eb5-4600-a486-67feca5bc94e', '543bdf47-a7ac-40a0-aec7-d62b605fe874'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:18 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:18 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "cinder-087767ca-3822-4415-9351-3752bbfbe048-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-087767ca-3822-4415-9351-3752bbfbe048-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "cinder-quobyte-087767ca-3822-4415-9351-3752bbfbe048" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-quobyte-087767ca-3822-4415-9351-3752bbfbe048" acquired by "delete_volume" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04ecce3-6d70-4993-a432-9d6513bbd4e9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:19 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048 Apr 29 10:38:19 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Acquiring lock "cinder-58b1239d-54ab-409a-a08d-5df5c4a14451-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:19 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.718s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Lock "cinder-58b1239d-54ab-409a-a08d-5df5c4a14451-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Deleted volume successfully. Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-64266c60-a942-4188-8169-3a8277b03253 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-b63474c9-0200-4bc9-ae81-e08c452a6d11-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Acquiring lock "cinder-quobyte-58b1239d-54ab-409a-a08d-5df5c4a14451" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Lock "cinder-quobyte-58b1239d-54ab-409a-a08d-5df5c4a14451" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8228384e-21b5-4374-90de-dc6bdef150f5]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "cinder-b26d5989-fa55-49b6-b5a1-d8047db0fb77-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-b26d5989-fa55-49b6-b5a1-d8047db0fb77-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:19 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451 Apr 29 10:38:19 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "cinder-quobyte-b26d5989-fa55-49b6-b5a1-d8047db0fb77" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-quobyte-b26d5989-fa55-49b6-b5a1-d8047db0fb77" acquired by "delete_volume" :: waited 0.034s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[85420b8a-85aa-4989-90af-5c40ee487b89]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:20 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77 Apr 29 10:38:20 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:20 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048" returned: 0 in 1.181s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:20 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048 Apr 29 10:38:20 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:20 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451" returned: 0 in 1.109s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:20 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451 Apr 29 10:38:20 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:21 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77" returned: 0 in 1.180s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:21 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77 Apr 29 10:38:21 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:21 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-087767ca-3822-4415-9351-3752bbfbe048" returned: 0 in 0.740s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-quobyte-087767ca-3822-4415-9351-3752bbfbe048" released by "delete_volume" :: held 1.969s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Created reservations ['7cb70a57-c28a-430f-92d1-72c73daf2be8', 'cac6ec4f-5247-4dd6-9e31-700347dbbf98', '64681ab5-7ccb-44f9-bc22-82655d6f9538', '952a04af-560f-4c3c-abc0-099acbda6e58'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "cinder-230b67be-7d68-4803-9894-01ca799c9813-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:21 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:21 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-230b67be-7d68-4803-9894-01ca799c9813-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "cinder-quobyte-230b67be-7d68-4803-9894-01ca799c9813" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-quobyte-230b67be-7d68-4803-9894-01ca799c9813" acquired by "delete_volume" :: waited 0.030s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44f53d3-f359-451a-8d78-92a3d6bc0ad7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:21 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813 Apr 29 10:38:21 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:21 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-58b1239d-54ab-409a-a08d-5df5c4a14451" returned: 0 in 1.034s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Lock "cinder-quobyte-58b1239d-54ab-409a-a08d-5df5c4a14451" released by "delete_volume" :: held 2.207s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Created reservations ['01ff8b26-17c7-476c-99a4-1b205a6e4f92', 'd26aa798-bd66-4e01-ac7f-54ef034a31c0', '2bcbcea6-1c58-4dcf-a05f-7e7d8f3be963', '9563eecb-236b-4e04-8b96-c0d3a246c7d3'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:22 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b26d5989-fa55-49b6-b5a1-d8047db0fb77" returned: 0 in 1.046s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-quobyte-b26d5989-fa55-49b6-b5a1-d8047db0fb77" released by "delete_volume" :: held 2.349s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:22 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:22 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:22 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.957s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Created reservations ['39b22a0d-2390-4bf8-9345-64cdb191bc5a', '4bea6cdd-c363-4fb7-b1ea-0a6926c2d321', '5a69e791-449c-46e1-b7ba-7b5c781eaca4', '6d5aca7c-78a0-44df-8e24-4932c1541be9'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:22 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Deleted volume successfully. Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f234ead6-28fc-4e60-affd-df3081ff43e7 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-087767ca-3822-4415-9351-3752bbfbe048-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:22 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:22 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:22 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813" returned: 0 in 1.133s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:22 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813 Apr 29 10:38:22 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:23 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.795s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Deleted volume successfully. Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9b8716d-906a-4d14-a94f-57602e2cacc4 tempest-VolumesListAdminTestJSON-1105733465 None] Lock "cinder-58b1239d-54ab-409a-a08d-5df5c4a14451-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "cinder-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:23 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.707s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Deleted volume successfully. Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-08ba51e1-0c08-4711-a142-11187dc25322 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-b26d5989-fa55-49b6-b5a1-d8047db0fb77-delete_volume" released by "delete_volume" :: held 3.630s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "cinder-quobyte-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-quobyte-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63" acquired by "delete_volume" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[01046366-db65-4f11-9d47-e9c6bc940ff3]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:23 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-230b67be-7d68-4803-9894-01ca799c9813" returned: 0 in 0.705s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-quobyte-230b67be-7d68-4803-9894-01ca799c9813" released by "delete_volume" :: held 1.904s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Created reservations ['f6145da1-e4cc-427a-95af-ec5245528da9', 'e5e44626-a747-4c78-a6c7-3ed7d454b3bb', '5e6b9d42-a91b-42ab-9528-3f14542cc621', 'dbfb8771-7369-43a9-858a-e8bbbd828413'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:23 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 Apr 29 10:38:23 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:23 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:23 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "cinder-88a23b13-2c65-42d1-b236-5308e28c5a92-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-88a23b13-2c65-42d1-b236-5308e28c5a92-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "cinder-quobyte-88a23b13-2c65-42d1-b236-5308e28c5a92" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-quobyte-88a23b13-2c65-42d1-b236-5308e28c5a92" acquired by "delete_volume" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f034839c-6e24-4ae8-beaa-32dbce8811e2]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:24 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92 Apr 29 10:38:24 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:24 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63" returned: 0 in 0.728s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:24 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63 Apr 29 10:38:24 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:24 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.656s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:24 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:24 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Deleted volume successfully. Apr 29 10:38:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a66448f-c851-47c6-9639-4398d0098e99 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-230b67be-7d68-4803-9894-01ca799c9813-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:24 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92" returned: 0 in 0.744s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:24 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92 Apr 29 10:38:24 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:24 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63" returned: 0 in 0.634s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-quobyte-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63" released by "delete_volume" :: held 1.410s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Created reservations ['2be59b02-448c-48d6-a1ea-c2f40ea0d3e5', '46229279-0f4e-4f88-a289-99b0147a58c6', '7021cbff-b5ff-4732-9f9f-4e9dc74b7258', '50666a30-0ae1-486e-9d0a-b41eaf68f2b0'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:25 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:25 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:25 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-88a23b13-2c65-42d1-b236-5308e28c5a92" returned: 0 in 0.597s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-quobyte-88a23b13-2c65-42d1-b236-5308e28c5a92" released by "delete_volume" :: held 1.383s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Created reservations ['d946ddff-cbae-4cc2-8ba4-566061db177d', 'c2418400-65a1-4b1d-95a8-d1e7dcabfd30', '074e5949-d543-4232-be16-8539525caebc', 'b6304706-62ec-48f3-a466-5366e533bcd7'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:25 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:25 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:25 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.644s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:25 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Deleted volume successfully. Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2e12f3ce-a056-452a-ac21-eedc28a9cf7a tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-6db1cbe5-a9f8-42d1-a6a3-ead300abcd63-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "cinder-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "cinder-quobyte-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-quobyte-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8" acquired by "delete_volume" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8ea834-430b-47ad-9229-9fd03addd5ce]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:26 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 Apr 29 10:38:26 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:26 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.606s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:26 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Deleted volume successfully. Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-20c9e1ce-42e6-4007-a5c6-6476f1a3d0d4 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-88a23b13-2c65-42d1-b236-5308e28c5a92-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "cinder-a73c4694-aa7c-4bb5-9385-c2694e9a8776-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-a73c4694-aa7c-4bb5-9385-c2694e9a8776-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "cinder-quobyte-a73c4694-aa7c-4bb5-9385-c2694e9a8776" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-quobyte-a73c4694-aa7c-4bb5-9385-c2694e9a8776" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[336917b9-9b81-46ff-986f-7dfb2a138701]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:26 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776 Apr 29 10:38:26 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:26 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8" returned: 0 in 0.724s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:26 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8 Apr 29 10:38:26 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:26 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776" returned: 0 in 0.714s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:26 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776 Apr 29 10:38:26 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:27 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8" returned: 0 in 0.638s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-quobyte-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8" released by "delete_volume" :: held 1.413s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Created reservations ['595602b7-8817-4f90-9eed-c84e75bc85c4', 'a5d917d2-9ed2-4780-b619-7b4c92b4a2f5', '721cd07b-c5b8-4062-8d3a-04313ad4aa24', '67043682-5d24-4a44-ae6b-77bd48202c1c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:27 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:27 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:27 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a73c4694-aa7c-4bb5-9385-c2694e9a8776" returned: 0 in 0.617s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-quobyte-a73c4694-aa7c-4bb5-9385-c2694e9a8776" released by "delete_volume" :: held 1.371s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Created reservations ['7622e631-7999-465a-828c-b0146552ac69', 'bcf69c67-a412-4e34-9ac0-95b2c2f2ce48', '21aacde4-925d-42d3-997c-55af0ff5ae88', '12231175-a7e7-472e-89e3-6d04ac782678'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:27 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:27 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:28 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.597s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:28 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:28 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Deleted volume successfully. Apr 29 10:38:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-706097b1-7fc3-4e59-88e9-21c3f9cf7274 tempest-VolumesListAdminTestJSON-1806628532 None] Lock "cinder-fa0f85d4-c70f-4e22-8739-37d9f00fb0e8-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:28 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.657s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:28 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:28 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Deleted volume successfully. Apr 29 10:38:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4fb44eaa-19d6-402c-8f1a-bdf9e9cc0089 tempest-CreateVolumesFromImageTest-1178055673 None] Lock "cinder-a73c4694-aa7c-4bb5-9385-c2694e9a8776-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Flow 'volume_create_manager' (8b60dbb9-1b6c-44dc-883d-2e3b0942367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fddc8e-34a2-4b74-bee7-83eecaabab6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fddc8e-34a2-4b74-bee7-83eecaabab6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1459101306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713f8af9-b394-418a-88d3-fb695aded5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bd9f5a73744a46955b2539bbbdf0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:31Z,use_quota=True,user_id='b0c8559b1ee24f358b9354173561bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5623c819-9840-4a53-832d-745dd97e0890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5623c819-9840-4a53-832d-745dd97e0890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c00115-cf42-4459-9348-a7296c97e282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c00115-cf42-4459-9348-a7296c97e282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713f8af9-b394-418a-88d3-fb695aded5fd', 'volume_name': 'volume-713f8af9-b394-418a-88d3-fb695aded5fd', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff70e224-7424-4258-9349-03e31e66b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff70e224-7424-4258-9349-03e31e66b467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde6856f-326c-4d66-ada2-3f8ff9b46a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:31 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Volume 713f8af9-b394-418a-88d3-fb695aded5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713f8af9-b394-418a-88d3-fb695aded5fd', 'volume_size': 1} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1459101306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713f8af9-b394-418a-88d3-fb695aded5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bd9f5a73744a46955b2539bbbdf0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:31Z,use_quota=True,user_id='b0c8559b1ee24f358b9354173561bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Creating volume 713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:31 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:31 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd 1073741824 Apr 29 10:38:31 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:32 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd 1073741824" returned: 0 in 0.874s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:32 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd Apr 29 10:38:32 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:33 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:33 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:33 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd" returned: 0 in 0.672s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde6856f-326c-4d66-ada2-3f8ff9b46a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713f8af9-b394-418a-88d3-fb695aded5fd', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab45882-bc87-4381-b16f-62282b289efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:33 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Volume volume-713f8af9-b394-418a-88d3-fb695aded5fd (713f8af9-b394-418a-88d3-fb695aded5fd): created successfully Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab45882-bc87-4381-b16f-62282b289efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Flow 'volume_create_manager' (8b60dbb9-1b6c-44dc-883d-2e3b0942367e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:33 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f46f1f6a-9811-473c-98c2-0f4915c35693 tempest-VolumeDependencyTests-2001155389 None] Created volume successfully. Apr 29 10:38:33 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.682s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Creating offline snapshot 718be163-582f-404e-ba0f-eddf9b9b6a51 of volume 713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b1459b-0d33-4793-8b84-bb060bf4b6f0]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:34 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd Apr 29 10:38:34 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Flow 'volume_create_manager' (2910ae45-3dcd-4782-bc99-aae3dcd0a567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141850bc-ef7a-4206-b554-c52118b77dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141850bc-ef7a-4206-b554-c52118b77dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-957084785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b730d62ce8246e4a76dc900ef533102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:34Z,use_quota=True,user_id='cf89e50466c2489ca9d96043669dd67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c486d074-1208-4b95-8ecd-80a10bdd30a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c486d074-1208-4b95-8ecd-80a10bdd30a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f29ff6c-e761-4b43-9a88-0b567b25d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f29ff6c-e761-4b43-9a88-0b567b25d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84dcef2-fb2e-4ccf-9f39-d3e08b4140a3', 'volume_name': 'volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49159f8c-8a65-445e-bfcc-56030b322249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49159f8c-8a65-445e-bfcc-56030b322249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ade18d6-e193-458d-8967-2f986bc29543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:34 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Volume d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3', 'volume_size': 1} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Acquiring lock "cinder-abc71afd-e372-4f75-9b4d-bd5e1abad093-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Lock "cinder-abc71afd-e372-4f75-9b4d-bd5e1abad093-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Acquiring lock "cinder-quobyte-abc71afd-e372-4f75-9b4d-bd5e1abad093" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Lock "cinder-quobyte-abc71afd-e372-4f75-9b4d-bd5e1abad093" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[003ca03f-2412-4241-90e9-bfadacb3f4b7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:34 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093 Apr 29 10:38:34 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:34 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd" returned: 0 in 0.783s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:34 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 1G Apr 29 10:38:34 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:35 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093" returned: 0 in 0.685s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:35 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093 Apr 29 10:38:35 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:35 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 1G" returned: 0 in 0.792s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713f8af9-b394-418a-88d3-fb695aded5fd -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:35 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713f8af9-b394-418a-88d3-fb695aded5fd -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 Apr 29 10:38:35 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:35 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-abc71afd-e372-4f75-9b4d-bd5e1abad093" returned: 0 in 0.653s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Lock "cinder-quobyte-abc71afd-e372-4f75-9b4d-bd5e1abad093" released by "delete_volume" :: held 1.382s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Created reservations ['0c8534a3-c161-4157-88fa-bec879f59f6d', '389cf0e6-21b2-4d52-8c2c-6d17ff83f398', '51b98d3f-a139-40fc-a4e0-f67ac9b293bb', 'f530cc1e-fb54-4f50-a2d1-9d8e3a40bda7'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:35 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:35 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:36 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713f8af9-b394-418a-88d3-fb695aded5fd -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51" returned: 0 in 0.662s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:36 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 is being set with open permissions: ugo+rw Apr 29 10:38:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:36 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 Apr 29 10:38:36 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:36 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.670s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:36 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:36 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Deleted volume successfully. Apr 29 10:38:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-187f27f3-7efb-4a0f-9f56-06e7fe9650b6 tempest-VolumesNegativeTest-1761904376 None] Lock "cinder-abc71afd-e372-4f75-9b4d-bd5e1abad093-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:36 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51" returned: 0 in 0.605s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:36 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.info Apr 29 10:38:36 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:37 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.info" returned: 0 in 0.672s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:37 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.info is being set with open permissions: ugo+rw Apr 29 10:38:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:37 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.info Apr 29 10:38:37 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:38 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.info" returned: 0 in 0.611s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.223s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.808s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-957084785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b730d62ce8246e4a76dc900ef533102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:34Z,use_quota=True,user_id='cf89e50466c2489ca9d96043669dd67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Creating volume d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:38 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:38 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 1073741824 Apr 29 10:38:38 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:38 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-08b37089-b8f7-4844-b310-84224df08b57 tempest-VolumeDependencyTests-2001155389 None] Create snapshot completed successfully Apr 29 10:38:38 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 1073741824" returned: 0 in 0.837s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:38 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 Apr 29 10:38:38 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:39 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3" returned: 0 in 0.679s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ade18d6-e193-458d-8967-2f986bc29543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087970b9-35d8-4421-9fd7-fd4d720f6356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Flow 'volume_create_manager' (6ea3d3ee-9fac-45c1-b366-11fe8ece7fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaee8877-8538-45f6-916a-f379ca0033e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:39 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Volume volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 (d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3): created successfully Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087970b9-35d8-4421-9fd7-fd4d720f6356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Flow 'volume_create_manager' (2910ae45-3dcd-4782-bc99-aae3dcd0a567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaee8877-8538-45f6-916a-f379ca0033e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-612560664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43556bb1-dedb-4fc6-8e0b-f741c41c89fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bd9f5a73744a46955b2539bbbdf0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=718be163-582f-404e-ba0f-eddf9b9b6a51,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:40Z,use_quota=True,user_id='b0c8559b1ee24f358b9354173561bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5415537a-3165-4990-b3ee-5aa35db2abf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5415537a-3165-4990-b3ee-5aa35db2abf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6c06b6-5f5f-4610-b758-d7e05d61fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6c06b6-5f5f-4610-b758-d7e05d61fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '43556bb1-dedb-4fc6-8e0b-f741c41c89fe', 'volume_name': 'volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe', 'volume_size': 1, 'snapshot_id': '718be163-582f-404e-ba0f-eddf9b9b6a51'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187e586c-09e3-4f34-a521-835994196584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187e586c-09e3-4f34-a521-835994196584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbaaadf-3d20-4bc9-a9e4-2f99a992129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:39 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Volume 43556bb1-dedb-4fc6-8e0b-f741c41c89fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe', 'volume_size': 1, 'snapshot_id': '718be163-582f-404e-ba0f-eddf9b9b6a51'} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-quobyte-718be163-582f-404e-ba0f-eddf9b9b6a51-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" by "_create_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:39 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-316c5bf0-e418-4b1b-91d7-aee313ce0bb9 tempest-VolumesTransfersTest-148125129 None] Created volume successfully. Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-718be163-582f-404e-ba0f-eddf9b9b6a51-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Creating volume 43556bb1-dedb-4fc6-8e0b-f741c41c89fe from snapshot 718be163-582f-404e-ba0f-eddf9b9b6a51 {{(pid=83806) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-quobyte-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] snapshot: 718be163-582f-404e-ba0f-eddf9b9b6a51, volume: 43556bb1-dedb-4fc6-8e0b-f741c41c89fe, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f962d996-eaad-4d8f-882e-669e5bdd1e66]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:39 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 Apr 29 10:38:39 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:40 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51" returned: 0 in 0.703s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-713f8af9-b394-418a-88d3-fb695aded5fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:38:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:38:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:38:40 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba20f57-e830-4dc1-9e2c-0207630a55e9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:40 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd Apr 29 10:38:40 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:41 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-1bae0ce5-45fb-4481-b766-8903129a24e9 tempest-VolumesTransfersTest-968399350 None] Transfer volume completed successfully. Apr 29 10:38:41 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd" returned: 0 in 0.821s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:41 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:38:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:41 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe Apr 29 10:38:41 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Acquiring lock "cinder-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Lock "cinder-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Acquiring lock "cinder-quobyte-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Lock "cinder-quobyte-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3" acquired by "delete_volume" :: waited 0.059s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:42 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe305ea7-904c-4b14-a3a2-7f376d959443]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:42 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 Apr 29 10:38:42 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:43 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=133,cinder:INSERT=49,cinder:UPDATE=202,cinder:DELETE=16 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:38:44 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3" returned: 0 in 1.519s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:44 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3 Apr 29 10:38:44 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:45 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3" returned: 0 in 1.256s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Lock "cinder-quobyte-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3" released by "delete_volume" :: held 2.907s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:45 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Created reservations ['2e7a589d-d1c5-4497-9e8e-4374fd1d979d', '8955fcd0-afd2-448b-8d54-52c65166bf85', '7043da11-7f2f-4b0f-8a30-00b5bc3e65ef', 'f8f4373a-09ef-4b8d-976d-eb8796109fab'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:45 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:45 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:46 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.948s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:46 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:46 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Deleted volume successfully. Apr 29 10:38:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-110cd263-6967-4279-89d3-6a0102002671 tempest-VolumesTransfersTest-701948008 None] Lock "cinder-d84dcef2-fb2e-4ccf-9f39-d3e08b4140a3-delete_volume" released by "delete_volume" :: held 4.348s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Flow 'volume_create_manager' (8c677973-1c93-4a6a-b5e0-94c244b13ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b804f167-2674-4ff8-a387-44475a8eb92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b804f167-2674-4ff8-a387-44475a8eb92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1281384611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f6e947-6041-40cb-a7ce-82a95981973a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b730d62ce8246e4a76dc900ef533102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:48Z,use_quota=True,user_id='cf89e50466c2489ca9d96043669dd67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4104cfb-af1c-4be8-8255-6af1f55efa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:47 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4104cfb-af1c-4be8-8255-6af1f55efa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1890451-c452-4a33-83d5-90f6439f199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1890451-c452-4a33-83d5-90f6439f199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f6e947-6041-40cb-a7ce-82a95981973a', 'volume_name': 'volume-b6f6e947-6041-40cb-a7ce-82a95981973a', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94911375-53a3-429d-ab09-4c0b23ef95de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94911375-53a3-429d-ab09-4c0b23ef95de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b5e607-89df-468f-9646-fed126af6334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:47 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Volume b6f6e947-6041-40cb-a7ce-82a95981973a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f6e947-6041-40cb-a7ce-82a95981973a', 'volume_size': 1} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" returned: 0 in 6.223s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f47e02-5120-43f0-9dca-085c46c9effa]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:47 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd Apr 29 10:38:47 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:48 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd" returned: 0 in 0.986s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:48 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:38:48 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Converted 1024.00 MB image at 164.53 MB/s Apr 29 10:38:48 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe is being set with open permissions: ugo+rw Apr 29 10:38:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:48 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe Apr 29 10:38:48 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:49 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" returned: 0 in 0.638s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" released by "_copy_volume_from_snapshot" :: held 9.494s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-718be163-582f-404e-ba0f-eddf9b9b6a51-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" released by "_create_volume_from_snapshot" :: held 9.523s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.546s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1281384611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f6e947-6041-40cb-a7ce-82a95981973a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b730d62ce8246e4a76dc900ef533102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:48Z,use_quota=True,user_id='cf89e50466c2489ca9d96043669dd67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Creating volume b6f6e947-6041-40cb-a7ce-82a95981973a {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:49 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:49 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a 1073741824 Apr 29 10:38:49 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbaaadf-3d20-4bc9-a9e4-2f99a992129a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe', 'volume_size': 1, 'snapshot_id': '718be163-582f-404e-ba0f-eddf9b9b6a51'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cbff0a-c843-47e6-98d2-d1a0dd660d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:49 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Volume volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe (43556bb1-dedb-4fc6-8e0b-f741c41c89fe): created successfully Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cbff0a-c843-47e6-98d2-d1a0dd660d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Flow 'volume_create_manager' (6ea3d3ee-9fac-45c1-b366-11fe8ece7fbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:49 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-ac4f51f4-cb14-4df5-8a34-7e1bfd1c2924 tempest-VolumeDependencyTests-2001155389 None] Created volume successfully. Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-718be163-582f-404e-ba0f-eddf9b9b6a51-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-718be163-582f-404e-ba0f-eddf9b9b6a51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-quobyte-713f8af9-b394-418a-88d3-fb695aded5fd" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-713f8af9-b394-418a-88d3-fb695aded5fd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-quobyte-718be163-582f-404e-ba0f-eddf9b9b6a51" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-718be163-582f-404e-ba0f-eddf9b9b6a51" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Deleting offline snapshot 718be163-582f-404e-ba0f-eddf9b9b6a51 of volume 713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] snapshot_file for this snap is: volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6b6b69-b2dc-4b1f-be54-8001e9bcdc74]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:50 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 Apr 29 10:38:50 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:50 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a 1073741824" returned: 0 in 0.862s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:50 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a Apr 29 10:38:50 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:50 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51" returned: 0 in 0.854s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-713f8af9-b394-418a-88d3-fb695aded5fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:38:50 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a016e35-1c8b-4a78-995f-229cf93099f4]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:50 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a" returned: 0 in 0.716s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:51 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd Apr 29 10:38:51 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b5e607-89df-468f-9646-fed126af6334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f6e947-6041-40cb-a7ce-82a95981973a', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a712ef88-d0e6-444b-bcde-a0cedf19bb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:51 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Volume volume-b6f6e947-6041-40cb-a7ce-82a95981973a (b6f6e947-6041-40cb-a7ce-82a95981973a): created successfully Apr 29 10:38:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a712ef88-d0e6-444b-bcde-a0cedf19bb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Flow 'volume_create_manager' (8c677973-1c93-4a6a-b5e0-94c244b13ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-1c476280-0c89-412b-8df6-735b1e3e1d9e tempest-VolumesTransfersTest-148125129 None] Created volume successfully. Apr 29 10:38:51 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd" returned: 0 in 0.870s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:51 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 Apr 29 10:38:51 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Flow 'volume_create_manager' (581ab8c8-8725-4223-b99c-98f2f65b78a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8128d11-1eae-4128-abf7-057bbac5d3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8128d11-1eae-4128-abf7-057bbac5d3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1799506472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e497b66-78e5-4f8c-a576-93f5e0b35dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6da507d60748618e9fb9ad685c5c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:52Z,use_quota=True,user_id='98645aee62014b4b95cc0a80065ebfc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b98d75-2904-4716-ae38-13dae545cbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b98d75-2904-4716-ae38-13dae545cbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3636f60-c1b4-4602-9507-ed286d16f7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3636f60-c1b4-4602-9507-ed286d16f7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e497b66-78e5-4f8c-a576-93f5e0b35dfc', 'volume_name': 'volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9543d3b-0e98-4fa0-bd22-61f2925cff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9543d3b-0e98-4fa0-bd22-61f2925cff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b35b0a2-6b18-42f6-ba8d-ba123965b2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:52 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Volume 5e497b66-78e5-4f8c-a576-93f5e0b35dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc', 'volume_size': 1} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1799506472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e497b66-78e5-4f8c-a576-93f5e0b35dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6da507d60748618e9fb9ad685c5c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:52Z,use_quota=True,user_id='98645aee62014b4b95cc0a80065ebfc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Creating volume 5e497b66-78e5-4f8c-a576-93f5e0b35dfc {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:52 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:52 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc 1073741824 Apr 29 10:38:52 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Acquiring lock "cinder-b6f6e947-6041-40cb-a7ce-82a95981973a-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Lock "cinder-b6f6e947-6041-40cb-a7ce-82a95981973a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Acquiring lock "cinder-quobyte-b6f6e947-6041-40cb-a7ce-82a95981973a" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Lock "cinder-quobyte-b6f6e947-6041-40cb-a7ce-82a95981973a" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7e3344-114f-415c-85fe-a081244634a7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:52 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51" returned: 0 in 0.834s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:52 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51 Apr 29 10:38:52 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:52 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a Apr 29 10:38:52 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:53 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:53 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:53 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a" returned: 0 in 0.694s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc 1073741824" returned: 0 in 0.838s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd.718be163-582f-404e-ba0f-eddf9b9b6a51" returned: 0 in 0.635s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:53 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a Apr 29 10:38:53 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-718be163-582f-404e-ba0f-eddf9b9b6a51" released by "_delete_snapshot" :: held 3.353s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-713f8af9-b394-418a-88d3-fb695aded5fd" released by "delete_snapshot" :: held 3.389s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:53 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc Apr 29 10:38:53 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Created reservations ['aabe90c4-274a-48d0-addc-ced843ffcea0', '335ef724-7f0f-4d09-96d1-11ac376adcf4', 'da40376c-2c7f-4868-a0df-6a90c7ef5c51', '399a47db-2bdc-4275-a19d-7012c70670b7'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:53 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Delete snapshot completed successfully. Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b607fa45-291c-488c-854f-c8b6799db4db tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-718be163-582f-404e-ba0f-eddf9b9b6a51-delete_snapshot" released by "delete_snapshot" :: held 3.541s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:53 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b6f6e947-6041-40cb-a7ce-82a95981973a" returned: 0 in 0.695s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Lock "cinder-quobyte-b6f6e947-6041-40cb-a7ce-82a95981973a" released by "delete_volume" :: held 1.435s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Created reservations ['3f003d3a-e9c7-407b-ae40-20888c489b8f', '033d9f23-cbe5-436f-95bc-dfcf19d0678e', '0d314a32-4488-4314-812e-1bcc22aa808e', '66b49589-8574-465c-9661-be5b865de2d5'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:53 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" returned: 0 in 0.713s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b35b0a2-6b18-42f6-ba8d-ba123965b2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5549e8fa-e34c-4eed-a129-d12ca7893ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:54 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Volume volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc (5e497b66-78e5-4f8c-a576-93f5e0b35dfc): created successfully Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5549e8fa-e34c-4eed-a129-d12ca7893ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Flow 'volume_create_manager' (581ab8c8-8725-4223-b99c-98f2f65b78a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:54 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:54 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:54 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4d5e5b95-58bd-4052-a946-09905f1fee02 tempest-VolumesSnapshotTestJSON-897961592 None] Created volume successfully. Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-713f8af9-b394-418a-88d3-fb695aded5fd-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-713f8af9-b394-418a-88d3-fb695aded5fd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-quobyte-713f8af9-b394-418a-88d3-fb695aded5fd" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-713f8af9-b394-418a-88d3-fb695aded5fd" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab24c38f-41c7-40c6-b60e-bc5b62b02c69]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:54 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd Apr 29 10:38:54 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:54 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.661s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Creating offline snapshot 404ede48-90b2-4b09-98f6-b596716bba20 of volume 5e497b66-78e5-4f8c-a576-93f5e0b35dfc {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:38:54 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Deleted volume successfully. Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb541d35-1d12-4cf9-9521-6b4ebabc8332]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-87f4b697-c4f4-4594-be40-23a14d2c58d8 tempest-VolumesTransfersTest-701948008 None] Lock "cinder-b6f6e947-6041-40cb-a7ce-82a95981973a-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:54 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc Apr 29 10:38:54 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:55 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd" returned: 0 in 0.838s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:55 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd Apr 29 10:38:55 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:55 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" returned: 0 in 0.843s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:55 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 1G Apr 29 10:38:55 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:55 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-713f8af9-b394-418a-88d3-fb695aded5fd" returned: 0 in 0.710s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-713f8af9-b394-418a-88d3-fb695aded5fd" released by "delete_volume" :: held 1.622s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Created reservations ['710fe04b-47cf-4b3f-bce5-792a179539ae', 'cc8b7e0c-a047-4d7c-9c94-f0059a5c4476', '554e87b3-0591-420a-80d0-47aa76e438c7', 'a0e7b5cd-0af6-4e1d-bcef-c8c84565929a'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:56 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:38:56 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:56 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 1G" returned: 0 in 0.944s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:56 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 Apr 29 10:38:56 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:56 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.736s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:38:56 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Deleted volume successfully. Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b91adfc8-bbdf-4623-8747-5e8878552d76 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-713f8af9-b394-418a-88d3-fb695aded5fd-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Flow 'volume_create_manager' (f121784b-c521-452e-9127-89bdadba317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea55c073-bf5e-4886-9825-2286f8be74a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea55c073-bf5e-4886-9825-2286f8be74a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1529885043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e50c3bc-eca0-432a-85db-8b1b19445c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bd9f5a73744a46955b2539bbbdf0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:57Z,use_quota=True,user_id='b0c8559b1ee24f358b9354173561bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa42a20-cd2f-4428-8958-935696d6aa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa42a20-cd2f-4428-8958-935696d6aa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6117008-9757-4692-a451-3a5283890504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:57 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6117008-9757-4692-a451-3a5283890504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e50c3bc-eca0-432a-85db-8b1b19445c48', 'volume_name': 'volume-9e50c3bc-eca0-432a-85db-8b1b19445c48', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:57 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedcc7b4-e9ae-42ee-b004-654ffa637bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:57 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedcc7b4-e9ae-42ee-b004-654ffa637bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:38:57 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55ad5f7-c247-4466-a9f7-8dab9e925f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:38:57 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Volume 9e50c3bc-eca0-432a-85db-8b1b19445c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e50c3bc-eca0-432a-85db-8b1b19445c48', 'volume_size': 1} Apr 29 10:38:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:57 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20" returned: 0 in 0.849s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:57 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 is being set with open permissions: ugo+rw Apr 29 10:38:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:57 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 Apr 29 10:38:57 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:57 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20" returned: 0 in 0.607s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:57 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.info Apr 29 10:38:57 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:58 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.info" returned: 0 in 0.639s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:58 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.info is being set with open permissions: ugo+rw Apr 29 10:38:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:58 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.info Apr 29 10:38:58 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:59 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.info" returned: 0 in 0.586s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.574s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.186s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1529885043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e50c3bc-eca0-432a-85db-8b1b19445c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bd9f5a73744a46955b2539bbbdf0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:38:57Z,use_quota=True,user_id='b0c8559b1ee24f358b9354173561bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Creating volume 9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:38:59 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:38:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:38:59 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 1073741824 Apr 29 10:38:59 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:38:59 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b7ef45e8-4671-4fdd-b7cb-0b510531f91b tempest-VolumesSnapshotTestJSON-897961592 None] Create snapshot completed successfully Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-404ede48-90b2-4b09-98f6-b596716bba20-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-404ede48-90b2-4b09-98f6-b596716bba20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:00 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 1073741824" returned: 0 in 0.893s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-404ede48-90b2-4b09-98f6-b596716bba20" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-404ede48-90b2-4b09-98f6-b596716bba20" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Deleting offline snapshot 404ede48-90b2-4b09-98f6-b596716bba20 of volume 5e497b66-78e5-4f8c-a576-93f5e0b35dfc {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:39:00 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 Apr 29 10:39:00 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] snapshot_file for this snap is: volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[148e8949-0dd0-4ca7-80bd-11e80d726862]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:00 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 Apr 29 10:39:00 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:00 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48" returned: 0 in 0.682s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55ad5f7-c247-4466-a9f7-8dab9e925f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e50c3bc-eca0-432a-85db-8b1b19445c48', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7ba71f-b5be-40e0-ba54-5dec3976c917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:00 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Volume volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 (9e50c3bc-eca0-432a-85db-8b1b19445c48): created successfully Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7ba71f-b5be-40e0-ba54-5dec3976c917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:00 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Flow 'volume_create_manager' (f121784b-c521-452e-9127-89bdadba317c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:00 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-901cdccb-d2ee-4f3f-88a6-e94753d62d98 tempest-VolumeDependencyTests-2001155389 None] Created volume successfully. Apr 29 10:39:00 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20" returned: 0 in 0.775s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc48d8ac-4231-405b-9126-36238c4b949e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:01 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc Apr 29 10:39:01 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:39:01 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" returned: 0 in 0.769s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:01 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 Apr 29 10:39:01 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Flow 'volume_create_manager' (5dfa21f5-b6ac-48e0-934d-b5b4d35a2d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f279435-1c94-4c1c-832c-f8d752b78cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f279435-1c94-4c1c-832c-f8d752b78cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-102654387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08901f0a-cffb-41c3-b994-d150855eb48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45bd9f5a73744a46955b2539bbbdf0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9e50c3bc-eca0-432a-85db-8b1b19445c48,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:02Z,use_quota=True,user_id='b0c8559b1ee24f358b9354173561bd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31f4ff8-1c8a-4f3d-b499-5238440b6915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31f4ff8-1c8a-4f3d-b499-5238440b6915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08c8d24-2fe5-4f87-87df-43b3a11bcb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08c8d24-2fe5-4f87-87df-43b3a11bcb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '08901f0a-cffb-41c3-b994-d150855eb48b', 'volume_name': 'volume-08901f0a-cffb-41c3-b994-d150855eb48b', 'volume_size': 1, 'source_volid': '9e50c3bc-eca0-432a-85db-8b1b19445c48', 'source_volstatus': 'available'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e278b7-55c2-4119-b0e8-042660afde6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e278b7-55c2-4119-b0e8-042660afde6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc81613-6489-4f54-bd08-22d7611f15ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:01 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Volume 08901f0a-cffb-41c3-b994-d150855eb48b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-08901f0a-cffb-41c3-b994-d150855eb48b', 'volume_size': 1, 'source_volid': '9e50c3bc-eca0-432a-85db-8b1b19445c48', 'source_volstatus': 'available'} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Flow 'volume_create_manager' (181fb1eb-f00c-423a-abf6-4de714bb98c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b40a32-eb75-45fa-84b5-f3dd00fa73f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:01 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Cloning volume 9e50c3bc-eca0-432a-85db-8b1b19445c48 to volume 08901f0a-cffb-41c3-b994-d150855eb48b Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b40a32-eb75-45fa-84b5-f3dd00fa73f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1324796603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2db2056dce4bd69210105423e40a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:02Z,use_quota=True,user_id='bca8d3e0b12e43ad90c20751b8f35210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e91ca1-03ab-42c2-a70e-22a6b4bdfdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e91ca1-03ab-42c2-a70e-22a6b4bdfdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baa8ee8-cfcd-43f6-8967-83a2be7f903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baa8ee8-cfcd-43f6-8967-83a2be7f903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11', 'volume_name': 'volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babe07e1-e71f-41fb-bc97-79dbb0d732c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babe07e1-e71f-41fb-bc97-79dbb0d732c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f4e0fa-12e9-43bc-a90c-f4f27f194667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:01 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Volume 4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11', 'volume_size': 1} Apr 29 10:39:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Creating offline snapshot aa742245-e306-4e8f-be39-676875431089 of volume 9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:39:02 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca59720e-1fc8-4989-abeb-0c25c8e56d48]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:02 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 Apr 29 10:39:02 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:02 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20" returned: 0 in 0.653s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:02 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20 Apr 29 10:39:02 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:02 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48" returned: 0 in 0.810s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:02 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 1G Apr 29 10:39:02 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:03 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc.404ede48-90b2-4b09-98f6-b596716bba20" returned: 0 in 0.595s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-404ede48-90b2-4b09-98f6-b596716bba20" released by "_delete_snapshot" :: held 2.900s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" released by "delete_snapshot" :: held 2.936s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Created reservations ['c039c97f-793e-4e24-8242-d88b1dc6d830', 'a1c77874-ceee-43c6-81ed-155e77900ffb', 'dfa56108-64e3-442f-b51b-0c7ae2c11ca6', '400696f4-5132-400e-a5e4-0a7ef63ce6f6'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:39:03 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Delete snapshot completed successfully. Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-82da696a-e2b4-4238-8c2c-b3e15282e2a0 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-404ede48-90b2-4b09-98f6-b596716bba20-delete_snapshot" released by "delete_snapshot" :: held 3.150s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:03 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 1G" returned: 0 in 0.780s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:03 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 Apr 29 10:39:03 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Flow 'volume_create_manager' (ea4aec0f-0133-4d11-b2cb-b746e9528389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef0c7a6-a8a8-42ee-b715-87f7326843c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef0c7a6-a8a8-42ee-b715-87f7326843c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2016072069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6da507d60748618e9fb9ad685c5c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:04Z,use_quota=True,user_id='98645aee62014b4b95cc0a80065ebfc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffdcf7c2-93cb-4bab-96d3-9426f35eb2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffdcf7c2-93cb-4bab-96d3-9426f35eb2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb755b84-5ba7-4b2a-bbe2-7993b7bc17da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb755b84-5ba7-4b2a-bbe2-7993b7bc17da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5', 'volume_name': 'volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770c7521-fd9b-416f-998d-f14db074dbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770c7521-fd9b-416f-998d-f14db074dbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576763b7-7615-4d35-b9f8-3f76c10dd3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:03 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Volume 6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5', 'volume_size': 1} Apr 29 10:39:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:04 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089" returned: 0 in 0.623s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:04 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 is being set with open permissions: ugo+rw Apr 29 10:39:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:04 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 Apr 29 10:39:04 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:04 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089" returned: 0 in 0.583s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:04 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.info Apr 29 10:39:04 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:05 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.info" returned: 0 in 0.565s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:05 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.info is being set with open permissions: ugo+rw Apr 29 10:39:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:05 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.info Apr 29 10:39:05 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:06 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.info" returned: 0 in 0.584s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-quobyte-08901f0a-cffb-41c3-b994-d150855eb48b" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-08901f0a-cffb-41c3-b994-d150855eb48b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] snapshot: aa742245-e306-4e8f-be39-676875431089, volume: 08901f0a-cffb-41c3-b994-d150855eb48b, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3314caa-979b-4896-8076-1dc46f8334b9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:06 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 Apr 29 10:39:06 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:06 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089" returned: 0 in 0.669s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e50c3bc-eca0-432a-85db-8b1b19445c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e98df15-63ee-490f-9e73-2d08e0c81fe4]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:06 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 Apr 29 10:39:06 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:07 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48" returned: 0 in 0.698s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:07 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:39:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:07 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b Apr 29 10:39:07 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:11 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b" returned: 0 in 4.380s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:11 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[663085f7-1d60-4676-a6c6-25cfe6588815]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:11 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 Apr 29 10:39:11 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:12 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48" returned: 0 in 0.825s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:12 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:39:12 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Converted 1024.00 MB image at 233.74 MB/s Apr 29 10:39:12 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b is being set with open permissions: ugo+rw Apr 29 10:39:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:12 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b Apr 29 10:39:12 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:13 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b" returned: 0 in 0.597s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:13 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-08901f0a-cffb-41c3-b994-d150855eb48b" released by "_copy_volume_from_snapshot" :: held 7.248s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:13 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:DELETE=16,cinder:SELECT=120,cinder:UPDATE=155,cinder:INSERT=34 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:39:13 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-quobyte-aa742245-e306-4e8f-be39-676875431089" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:13 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-aa742245-e306-4e8f-be39-676875431089" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Deleting offline snapshot aa742245-e306-4e8f-be39-676875431089 of volume 9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:39:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] snapshot_file for this snap is: volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:39:13 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[accc2548-3f66-45cb-ad2d-dc9859096bc6]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:13 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 Apr 29 10:39:13 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:14 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089" returned: 0 in 0.685s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e50c3bc-eca0-432a-85db-8b1b19445c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:39:14 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[23be8028-7d43-46ca-a0d5-8c16265c5e1c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:14 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 Apr 29 10:39:14 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:14 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48" returned: 0 in 0.709s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:14 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 Apr 29 10:39:14 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:14 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=45,cinder:INSERT=16,cinder:UPDATE=53,cinder:DELETE=2 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:39:15 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089" returned: 0 in 0.673s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:15 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089 Apr 29 10:39:15 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:16 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48.aa742245-e306-4e8f-be39-676875431089" returned: 0 in 0.558s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-aa742245-e306-4e8f-be39-676875431089" released by "_delete_snapshot" :: held 2.713s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.129s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.078s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1324796603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2db2056dce4bd69210105423e40a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:02Z,use_quota=True,user_id='bca8d3e0b12e43ad90c20751b8f35210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Creating volume 4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:39:16 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:16 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 1073741824 Apr 29 10:39:16 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc81613-6489-4f54-bd08-22d7611f15ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08901f0a-cffb-41c3-b994-d150855eb48b', 'volume_size': 1, 'source_volid': '9e50c3bc-eca0-432a-85db-8b1b19445c48', 'source_volstatus': 'available'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0373c889-d446-41a1-8d09-246a4dd49377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:16 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Volume volume-08901f0a-cffb-41c3-b994-d150855eb48b (08901f0a-cffb-41c3-b994-d150855eb48b): created successfully Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0373c889-d446-41a1-8d09-246a4dd49377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Flow 'volume_create_manager' (5dfa21f5-b6ac-48e0-934d-b5b4d35a2d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:16 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e9f18c06-5218-456f-acd0-8f59dde37139 tempest-VolumeDependencyTests-2001155389 None] Created volume successfully. Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-9e50c3bc-eca0-432a-85db-8b1b19445c48-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-9e50c3bc-eca0-432a-85db-8b1b19445c48-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-quobyte-9e50c3bc-eca0-432a-85db-8b1b19445c48" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:16 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-9e50c3bc-eca0-432a-85db-8b1b19445c48" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 1073741824" returned: 0 in 0.852s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d30b57f-7730-4b5e-b7cf-d1737a6e3712]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:17 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 Apr 29 10:39:17 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:17 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 Apr 29 10:39:17 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:17 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11" returned: 0 in 0.613s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.802s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2016072069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6da507d60748618e9fb9ad685c5c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:04Z,use_quota=True,user_id='98645aee62014b4b95cc0a80065ebfc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Creating volume 6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:39:17 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f4e0fa-12e9-43bc-a90c-f4f27f194667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a656457-840b-4f98-a6a2-d3e169b9b508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:17 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 1073741824 Apr 29 10:39:17 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:17 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Volume volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 (4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11): created successfully Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a656457-840b-4f98-a6a2-d3e169b9b508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Flow 'volume_create_manager' (181fb1eb-f00c-423a-abf6-4de714bb98c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:17 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5d8995df-9c71-451a-982b-519419b9dd56 tempest-VolumesTransfersV355Test-1771365411 None] Created volume successfully. Apr 29 10:39:17 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48" returned: 0 in 0.745s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:17 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48 Apr 29 10:39:17 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:18 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9e50c3bc-eca0-432a-85db-8b1b19445c48" returned: 0 in 0.587s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-9e50c3bc-eca0-432a-85db-8b1b19445c48" released by "delete_volume" :: held 1.394s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Created reservations ['cad971a2-d3f5-4767-a831-f6453614e57b', 'e86235d4-588e-43bd-beb4-4dcb407a5655', '8db34232-b22a-42cf-9cc6-829587a39f41', 'bc129776-e286-4ca2-9447-2141e4ddfa6a'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:18 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:39:18 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:18 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 1073741824" returned: 0 in 0.898s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:18 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 Apr 29 10:39:18 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:18 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-af535b28-76de-4367-8d67-89d573e49adc tempest-VolumesTransfersV355Test-1878207982 None] Transfer volume completed successfully. Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-08901f0a-cffb-41c3-b994-d150855eb48b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-08901f0a-cffb-41c3-b994-d150855eb48b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:19 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.687s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:39:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Deleted volume successfully. Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-quobyte-08901f0a-cffb-41c3-b994-d150855eb48b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:19 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" returned: 0 in 0.622s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-08901f0a-cffb-41c3-b994-d150855eb48b" acquired by "delete_volume" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576763b7-7615-4d35-b9f8-3f76c10dd3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a115100-470b-4341-80c8-71ffdb1a0eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bfe11f-7311-42f2-b1fa-92475e735d6e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3235d1ab-cc6d-4426-8f7e-64e243f9e569 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-9e50c3bc-eca0-432a-85db-8b1b19445c48-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:19 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Volume volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 (6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5): created successfully Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a115100-470b-4341-80c8-71ffdb1a0eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Flow 'volume_create_manager' (ea4aec0f-0133-4d11-b2cb-b746e9528389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-c96ca51d-7d7b-4854-9172-65be637ff43b tempest-VolumesSnapshotTestJSON-897961592 None] Created volume successfully. Apr 29 10:39:19 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b Apr 29 10:39:19 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Acquiring lock "cinder-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Lock "cinder-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Acquiring lock "cinder-quobyte-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Lock "cinder-quobyte-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7ed95e-31b7-4296-9741-e0e910c62afe]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:19 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 Apr 29 10:39:19 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:19 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b" returned: 0 in 0.730s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:19 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b Apr 29 10:39:19 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Creating offline snapshot acff5f21-097f-4f35-9219-370f3a0d03c5 of volume 6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d5ec3c-6244-4646-a728-19aa67dc9c6b]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:20 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 Apr 29 10:39:20 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:20 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11" returned: 0 in 0.765s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:20 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11 Apr 29 10:39:20 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:20 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-08901f0a-cffb-41c3-b994-d150855eb48b" returned: 0 in 0.620s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-08901f0a-cffb-41c3-b994-d150855eb48b" released by "delete_volume" :: held 1.413s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Created reservations ['4def7e43-f19a-43ba-b88c-ad135f9e2b9f', '8162debf-c983-40c8-b15e-5ca6e2356cfa', '63ca7036-7e2b-4847-a465-c888e0dead5b', 'de017adf-aae0-49b9-9e03-1ce9df24e096'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:20 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:39:20 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:20 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" returned: 0 in 0.765s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:20 devstack sudo[91595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 1G Apr 29 10:39:20 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:21 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11" returned: 0 in 0.605s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Lock "cinder-quobyte-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11" released by "delete_volume" :: held 1.416s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Created reservations ['9a767dff-68fb-42d0-beac-f1511a6862a7', '1c54788d-f9b9-4ae3-949e-898d8f075dc9', '3ed82024-f902-4c51-a697-d44609c6556b', 'f93c2092-3f3d-4591-bdda-92939397419b'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:21 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:39:21 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:21 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.649s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:39:21 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Deleted volume successfully. Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-43556bb1-dedb-4fc6-8e0b-f741c41c89fe-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b966e634-5f42-48de-b9c3-7f47d43ef16b tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-08901f0a-cffb-41c3-b994-d150855eb48b-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-43556bb1-dedb-4fc6-8e0b-f741c41c89fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "cinder-quobyte-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[1538e9e6-db4d-4d0c-9dd2-613e87e67a6e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:21 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 1G" returned: 0 in 0.827s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:21 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 Apr 29 10:39:21 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:21 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe Apr 29 10:39:21 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:21 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.641s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:39:21 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Deleted volume successfully. Apr 29 10:39:21 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a4b5777b-08cd-43a6-9296-c7cd83657523 tempest-VolumesTransfersV355Test-1481221682 None] Lock "cinder-4bd0e8b3-7a8d-4b03-9f59-d95e44d7cc11-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:22 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5" returned: 0 in 0.619s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:22 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 is being set with open permissions: ugo+rw Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:22 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 Apr 29 10:39:22 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Flow 'volume_create_manager' (65e9f933-aafe-44d0-9bb5-e6e956709333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbd8e7d-a676-4b83-af9b-bbadccebed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:22 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" returned: 0 in 0.825s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbd8e7d-a676-4b83-af9b-bbadccebed00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1847124203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2db2056dce4bd69210105423e40a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:22Z,use_quota=True,user_id='bca8d3e0b12e43ad90c20751b8f35210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:22 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe Apr 29 10:39:22 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736cd75a-d4b8-404f-9bf9-651b7670b228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736cd75a-d4b8-404f-9bf9-651b7670b228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c05b44-0b97-47c0-96ba-11eaa311d19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c05b44-0b97-47c0-96ba-11eaa311d19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d', 'volume_name': 'volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823daf9e-5e12-4498-9313-553fad9ee204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823daf9e-5e12-4498-9313-553fad9ee204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b560c795-c2cb-4124-8d3d-36f15a23f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:22 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Volume a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d', 'volume_size': 1} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:22 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5" returned: 0 in 0.651s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:22 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.info Apr 29 10:39:22 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:22 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" returned: 0 in 0.592s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:22 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-quobyte-43556bb1-dedb-4fc6-8e0b-f741c41c89fe" released by "delete_volume" :: held 1.461s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Created reservations ['96b90d4e-7e7d-46d4-9589-08cfc9275a07', '4e401ef2-d4bf-4870-8afa-cb61f2a1fa5f', 'ef335e3f-b6cc-468f-870e-e7b04c9a6da4', '1df8e786-54f5-44ad-b5a1-aecd5c2e18c6'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:23 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:39:23 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:23 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.info" returned: 0 in 0.599s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:23 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.info is being set with open permissions: ugo+rw Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:23 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.info Apr 29 10:39:23 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:23 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.622s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:39:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Deleted volume successfully. Apr 29 10:39:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-9de17b07-5aac-40ab-becb-8596caff5b27 tempest-VolumeDependencyTests-2001155389 None] Lock "cinder-43556bb1-dedb-4fc6-8e0b-f741c41c89fe-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:24 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.info" returned: 0 in 0.576s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.140s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1847124203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2db2056dce4bd69210105423e40a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:22Z,use_quota=True,user_id='bca8d3e0b12e43ad90c20751b8f35210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Creating volume a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:39:24 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:24 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d 1073741824 Apr 29 10:39:24 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:24 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-feb5927b-cb49-424b-9071-8ed4be0bdb79 tempest-VolumesSnapshotTestJSON-897961592 None] Create snapshot completed successfully Apr 29 10:39:24 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d 1073741824" returned: 0 in 0.816s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:24 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d Apr 29 10:39:24 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:25 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d" returned: 0 in 0.610s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b560c795-c2cb-4124-8d3d-36f15a23f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb8b101-dcaa-4930-a8c8-368f5bc1b343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:25 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Volume volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d (a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d): created successfully Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb8b101-dcaa-4930-a8c8-368f5bc1b343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Flow 'volume_create_manager' (65e9f933-aafe-44d0-9bb5-e6e956709333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:25 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-cd686bd3-57be-4013-839b-e11efe3e19c0 tempest-VolumesTransfersV355Test-1771365411 None] Created volume successfully. Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Flow 'volume_create_manager' (edc43933-e781-428c-a338-1578cf72ecb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4814fe67-58d7-4b9a-8484-104be027e951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4814fe67-58d7-4b9a-8484-104be027e951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-810549296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4f4dfb-cc7b-441b-9216-034aae82526b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6da507d60748618e9fb9ad685c5c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=acff5f21-097f-4f35-9219-370f3a0d03c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:26Z,use_quota=True,user_id='98645aee62014b4b95cc0a80065ebfc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3b1c20-29ee-40e1-80bb-09b30b73f5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3b1c20-29ee-40e1-80bb-09b30b73f5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9bdaef-61f8-491d-98ad-b6c1370591ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9bdaef-61f8-491d-98ad-b6c1370591ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f4f4dfb-cc7b-441b-9216-034aae82526b', 'volume_name': 'volume-8f4f4dfb-cc7b-441b-9216-034aae82526b', 'volume_size': 2, 'snapshot_id': 'acff5f21-097f-4f35-9219-370f3a0d03c5'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e2e950-2ac7-4d52-8720-a76d16d289da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e2e950-2ac7-4d52-8720-a76d16d289da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55c2afc-730b-4850-a431-6af6183e3869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:25 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Volume 8f4f4dfb-cc7b-441b-9216-034aae82526b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f4f4dfb-cc7b-441b-9216-034aae82526b', 'volume_size': 2, 'snapshot_id': 'acff5f21-097f-4f35-9219-370f3a0d03c5'} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-acff5f21-097f-4f35-9219-370f3a0d03c5-8f4f4dfb-cc7b-441b-9216-034aae82526b" by "_create_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-acff5f21-097f-4f35-9219-370f3a0d03c5-8f4f4dfb-cc7b-441b-9216-034aae82526b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Creating volume 8f4f4dfb-cc7b-441b-9216-034aae82526b from snapshot acff5f21-097f-4f35-9219-370f3a0d03c5 {{(pid=83806) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-8f4f4dfb-cc7b-441b-9216-034aae82526b" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-8f4f4dfb-cc7b-441b-9216-034aae82526b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] snapshot: acff5f21-097f-4f35-9219-370f3a0d03c5, volume: 8f4f4dfb-cc7b-441b-9216-034aae82526b, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eddb033-de06-47e9-8a0c-1812c4a73db5]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:26 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 Apr 29 10:39:26 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:26 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5" returned: 0 in 0.758s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:39:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:39:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:39:26 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e38bcf-0d73-4e56-a79d-4eb2219eb556]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:26 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 Apr 29 10:39:26 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Acquiring lock "cinder-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Lock "cinder-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Acquiring lock "cinder-quobyte-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Lock "cinder-quobyte-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d" acquired by "delete_volume" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:27 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f39ff5b-6373-46cb-9048-fc83f5ad880a]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:27 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d Apr 29 10:39:27 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:27 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" returned: 0 in 0.852s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:27 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:39:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:27 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b Apr 29 10:39:27 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:27 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d" returned: 0 in 0.773s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:27 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d Apr 29 10:39:27 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:28 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d" returned: 0 in 0.833s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Lock "cinder-quobyte-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d" released by "delete_volume" :: held 1.676s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:28 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Created reservations ['c91a0687-97c1-4dff-bfbb-3e419606d3f3', '1fedb2fb-e738-48f0-b11e-561907f56c0a', '2137abff-c0c8-432a-a583-e02edc226f66', '70d2405a-3ff9-41ea-9e63-e56c4c0a81d1'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:39:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:29 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:39:29 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:30 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.746s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:30 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:39:30 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Deleted volume successfully. Apr 29 10:39:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b207638a-ec16-465a-8cd2-f6e72c1ce071 tempest-VolumesTransfersV355Test-1481221682 None] Lock "cinder-a9b1f72d-69a5-4b6f-9f2e-c15818f68d1d-delete_volume" released by "delete_volume" :: held 3.947s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:33 devstack sudo[91676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:39:33 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b" returned: 0 in 6.050s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[57053f99-c61c-4aad-be08-34607d134757]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:33 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 Apr 29 10:39:33 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:33 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.818s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:39:34 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" returned: 0 in 1.064s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:34 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:39:34 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Converted 1024.00 MB image at 169.22 MB/s Apr 29 10:39:34 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b is being set with open permissions: ugo+rw Apr 29 10:39:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:34 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b Apr 29 10:39:34 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:35 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b" returned: 0 in 0.649s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-8f4f4dfb-cc7b-441b-9216-034aae82526b" released by "_copy_volume_from_snapshot" :: held 9.493s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-acff5f21-097f-4f35-9219-370f3a0d03c5-8f4f4dfb-cc7b-441b-9216-034aae82526b" released by "_create_volume_from_snapshot" :: held 9.540s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.556s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55c2afc-730b-4850-a431-6af6183e3869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4f4dfb-cc7b-441b-9216-034aae82526b', 'volume_size': 2, 'snapshot_id': 'acff5f21-097f-4f35-9219-370f3a0d03c5'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ffc8ff-ed12-4f47-9b7c-fcf17bca5f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:35 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Volume volume-8f4f4dfb-cc7b-441b-9216-034aae82526b (8f4f4dfb-cc7b-441b-9216-034aae82526b): created successfully Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ffc8ff-ed12-4f47-9b7c-fcf17bca5f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Flow 'volume_create_manager' (edc43933-e781-428c-a338-1578cf72ecb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:35 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-aa5479d0-a4c2-422c-bab4-70ae225e7681 tempest-VolumesSnapshotTestJSON-897961592 None] Created volume successfully. Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-8f4f4dfb-cc7b-441b-9216-034aae82526b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-8f4f4dfb-cc7b-441b-9216-034aae82526b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-8f4f4dfb-cc7b-441b-9216-034aae82526b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-8f4f4dfb-cc7b-441b-9216-034aae82526b" acquired by "delete_volume" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:36 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a8483a-d315-4af7-a9ef-975de829a647]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:36 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b Apr 29 10:39:36 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:36 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b" returned: 0 in 0.821s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:36 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b Apr 29 10:39:36 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:37 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f4f4dfb-cc7b-441b-9216-034aae82526b" returned: 0 in 0.745s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:37 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-8f4f4dfb-cc7b-441b-9216-034aae82526b" released by "delete_volume" :: held 1.628s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:37 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Created reservations ['bcef3311-17dc-4466-896a-729145ec98a3', '5b90b0a4-ffc3-4ef4-87a2-19947b36d2f3', '4548d95f-e3ad-4ff0-81db-6946c19ba6a3', '2e879d37-cb70-4dfd-911f-11f0db5fb564'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:39:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:37 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:39:37 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-acff5f21-097f-4f35-9219-370f3a0d03c5-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-acff5f21-097f-4f35-9219-370f3a0d03c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-acff5f21-097f-4f35-9219-370f3a0d03c5" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-acff5f21-097f-4f35-9219-370f3a0d03c5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Deleting offline snapshot acff5f21-097f-4f35-9219-370f3a0d03c5 of volume 6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] snapshot_file for this snap is: volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a94a54-1d12-4a70-b57a-145bcab76eaf]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:38 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 Apr 29 10:39:38 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:38 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.983s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:39:38 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Deleted volume successfully. Apr 29 10:39:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2cb1edea-6c7f-4575-b35e-ac8c06ff05f8 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-8f4f4dfb-cc7b-441b-9216-034aae82526b-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Flow 'volume_create_manager' (c155d6c4-4ba7-4014-bd51-1d54ba66ae3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcd470a-af28-41e8-9ea9-6c7164ce53ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcd470a-af28-41e8-9ea9-6c7164ce53ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1399751511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986cdea7-fe00-4423-a9ba-d9a42250dadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e0e6a75af44b88b455e7d33cb7f176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:39Z,use_quota=True,user_id='75ac426e684b4d59ad508e5932162310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76242873-0311-4aa4-ba76-0765e829c273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76242873-0311-4aa4-ba76-0765e829c273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75eab2df-520f-4250-a3d5-1b1f753e1d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75eab2df-520f-4250-a3d5-1b1f753e1d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '986cdea7-fe00-4423-a9ba-d9a42250dadc', 'volume_name': 'volume-986cdea7-fe00-4423-a9ba-d9a42250dadc', 'volume_size': 2}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d9922b-c8ed-4d59-aa6c-1bc90ece3a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d9922b-c8ed-4d59-aa6c-1bc90ece3a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bc6785-70af-492c-97cc-a9e954f3869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:39 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Volume 986cdea7-fe00-4423-a9ba-d9a42250dadc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-986cdea7-fe00-4423-a9ba-d9a42250dadc', 'volume_size': 2} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1399751511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986cdea7-fe00-4423-a9ba-d9a42250dadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e0e6a75af44b88b455e7d33cb7f176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:39Z,use_quota=True,user_id='75ac426e684b4d59ad508e5932162310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Creating volume 986cdea7-fe00-4423-a9ba-d9a42250dadc {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:39:39 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc 2147483648 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:39 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc 2147483648 Apr 29 10:39:39 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:39 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5" returned: 0 in 1.056s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[422fca34-dc95-46f1-91cc-80b01c3504ad]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:39 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 Apr 29 10:39:39 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:40 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" returned: 0 in 0.743s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:40 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 Apr 29 10:39:40 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:40 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc 2147483648" returned: 0 in 1.093s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:40 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc Apr 29 10:39:40 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:41 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5" returned: 0 in 0.706s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:41 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5 Apr 29 10:39:41 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:41 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc" returned: 0 in 0.712s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bc6785-70af-492c-97cc-a9e954f3869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-986cdea7-fe00-4423-a9ba-d9a42250dadc', 'volume_size': 2}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071db730-727c-4079-950b-fd136565ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:41 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Volume volume-986cdea7-fe00-4423-a9ba-d9a42250dadc (986cdea7-fe00-4423-a9ba-d9a42250dadc): created successfully Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071db730-727c-4079-950b-fd136565ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Flow 'volume_create_manager' (c155d6c4-4ba7-4014-bd51-1d54ba66ae3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:41 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4aaddbff-1cfa-479b-b908-54ebe956dc03 tempest-VolumesCloneNegativeTest-2027068810 None] Created volume successfully. Apr 29 10:39:41 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5.acff5f21-097f-4f35-9219-370f3a0d03c5" returned: 0 in 0.666s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-acff5f21-097f-4f35-9219-370f3a0d03c5" released by "_delete_snapshot" :: held 3.322s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" released by "delete_snapshot" :: held 3.352s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Created reservations ['10abb871-2fec-4382-abec-713a744466f8', 'fa7f2f2d-84e4-40bb-9177-1baecd5a3b0c', '96549f8a-df0b-46dc-ae15-2d31d4a3f65a', 'f350b963-8b9e-43c5-943a-4f97ba3640ee'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:39:41 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Delete snapshot completed successfully. Apr 29 10:39:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f43e4d0b-aa03-4db1-af86-99625e302b9f tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-acff5f21-097f-4f35-9219-370f3a0d03c5-delete_snapshot" released by "delete_snapshot" :: held 3.500s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Acquiring lock "cinder-986cdea7-fe00-4423-a9ba-d9a42250dadc-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Lock "cinder-986cdea7-fe00-4423-a9ba-d9a42250dadc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Acquiring lock "cinder-quobyte-986cdea7-fe00-4423-a9ba-d9a42250dadc" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Lock "cinder-quobyte-986cdea7-fe00-4423-a9ba-d9a42250dadc" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[373a733e-7243-43c2-9e8e-8f1ae291eb28]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:42 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc Apr 29 10:39:42 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7ac65-673d-44cb-8f27-b584dd26413f]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:42 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 Apr 29 10:39:42 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:43 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc" returned: 0 in 0.768s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:43 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc Apr 29 10:39:43 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:43 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" returned: 0 in 0.860s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:43 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5 Apr 29 10:39:43 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:44 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-986cdea7-fe00-4423-a9ba-d9a42250dadc" returned: 0 in 0.647s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Lock "cinder-quobyte-986cdea7-fe00-4423-a9ba-d9a42250dadc" released by "delete_volume" :: held 1.460s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Created reservations ['099a7896-f188-401c-8c84-0054d41c18ba', 'da41901d-3e3d-47bd-9d66-68d2acfcb598', 'f1662872-58f1-47f6-b70a-fd4d4564d507', '68fe8066-4e19-4fb7-8e84-3bd8b7ed7471'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:44 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:39:44 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:44 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" returned: 0 in 0.640s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5" released by "delete_volume" :: held 1.569s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Created reservations ['d756e19f-288d-4132-85a0-03e35c991ebf', '4af1506b-15b7-4442-8b26-59f2ed8b1a8a', '59d317ba-daff-4e55-988e-77cf7470f701', 'd12d574c-eac4-4eac-a5a7-f088867f08f5'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:44 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:39:44 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:45 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.048s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:39:45 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Deleted volume successfully. Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-1e9c4c0a-69b4-44d6-82ed-efec3eebbfe1 tempest-VolumesCloneNegativeTest-2027068810 None] Lock "cinder-986cdea7-fe00-4423-a9ba-d9a42250dadc-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:45 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.080s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:39:45 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Deleted volume successfully. Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-77191d46-d7da-48f7-8364-40c6d13b0e7e tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-6ceae18a-b6d6-4ce7-b24d-d8d45d2f7ba5-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Flow 'volume_create_manager' (b0565b7c-ddfd-4964-b375-c4f9434173a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8bc2ce-f0f2-4c8a-8690-44d841474e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8bc2ce-f0f2-4c8a-8690-44d841474e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-204773140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63535613-88b9-4951-99c9-2d432e776363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6da507d60748618e9fb9ad685c5c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:46Z,use_quota=True,user_id='98645aee62014b4b95cc0a80065ebfc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e118dd0e-3093-4180-9082-55e0c8d71cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e118dd0e-3093-4180-9082-55e0c8d71cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6e5921-48a0-442e-875f-86c2f61bc685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6e5921-48a0-442e-875f-86c2f61bc685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63535613-88b9-4951-99c9-2d432e776363', 'volume_name': 'volume-63535613-88b9-4951-99c9-2d432e776363', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ab59db-eaa9-4dd3-afae-36d18537ae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ab59db-eaa9-4dd3-afae-36d18537ae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b129af23-8577-4d57-83b0-57eb7471acb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:45 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Volume 63535613-88b9-4951-99c9-2d432e776363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63535613-88b9-4951-99c9-2d432e776363', 'volume_size': 1} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-204773140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63535613-88b9-4951-99c9-2d432e776363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6da507d60748618e9fb9ad685c5c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:46Z,use_quota=True,user_id='98645aee62014b4b95cc0a80065ebfc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Creating volume 63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:39:45 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:39:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:46 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 1073741824 Apr 29 10:39:46 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:46 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 1073741824" returned: 0 in 0.972s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:47 devstack sudo[91758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 Apr 29 10:39:47 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:47 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363" returned: 0 in 0.668s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:47 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:39:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b129af23-8577-4d57-83b0-57eb7471acb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63535613-88b9-4951-99c9-2d432e776363', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bdcc8c-504f-4202-b21a-c651a0aba7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:47 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Volume volume-63535613-88b9-4951-99c9-2d432e776363 (63535613-88b9-4951-99c9-2d432e776363): created successfully Apr 29 10:39:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bdcc8c-504f-4202-b21a-c651a0aba7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:47 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Flow 'volume_create_manager' (b0565b7c-ddfd-4964-b375-c4f9434173a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:47 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e1487849-5a1f-47eb-a67b-db83684fdb75 tempest-VolumesSnapshotTestJSON-897961592 None] Created volume successfully. Apr 29 10:39:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Creating offline snapshot bfad2279-742f-4783-908d-0b4f659eca2c of volume 63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:39:48 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd4cba3-f742-4aaa-a655-99cbb2559f9f]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:48 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 Apr 29 10:39:48 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:49 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363" returned: 0 in 1.020s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:49 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c 1G Apr 29 10:39:49 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:50 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c 1G" returned: 0 in 1.038s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63535613-88b9-4951-99c9-2d432e776363 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:50 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63535613-88b9-4951-99c9-2d432e776363 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c Apr 29 10:39:50 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Flow 'volume_create_manager' (b0f2ae13-8ec6-4d1e-9fe6-4095fe927bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018edd96-4ea4-4c67-953d-c9775cf1b9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018edd96-4ea4-4c67-953d-c9775cf1b9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-246447619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604f2990-963f-4a41-8c3e-e7ac84df9aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2a0e237a394aa997e160d4e0c5ca5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:50Z,use_quota=True,user_id='f532daa47f7c4a658cfe7ef620b829cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74250e4-c674-4b98-995f-b12060ed5151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74250e4-c674-4b98-995f-b12060ed5151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d140196-e9d3-48ee-bc6a-13011d13a09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d140196-e9d3-48ee-bc6a-13011d13a09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604f2990-963f-4a41-8c3e-e7ac84df9aa1', 'volume_name': 'volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34ec849-078c-45c3-9e5b-b279fe57d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34ec849-078c-45c3-9e5b-b279fe57d12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d1f149-478c-4097-9792-c400513af87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:50 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Volume 604f2990-963f-4a41-8c3e-e7ac84df9aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1', 'volume_size': 1} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Flow 'volume_create_manager' (bd4cda38-c909-4065-8b6e-8600eeef0101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610825e2-cb5d-40f7-b89e-78db82c50e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610825e2-cb5d-40f7-b89e-78db82c50e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1148172553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c13b0dd-2fdf-4712-b36a-511d6bc86186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a2e19c69e546b6afc09d12e58a1d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:51Z,use_quota=True,user_id='e8d30b1e5a064f0780bb2e775e9efe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e193eb-887c-4273-a289-756fc05719ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e193eb-887c-4273-a289-756fc05719ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391cc6e2-a108-4eba-9301-8a8fc300cd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:50 devstack cinder-volume[83806]: DEBUG cinder.image.glance [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Creating Keystone auth plugin from conf {{(pid=83806) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391cc6e2-a108-4eba-9301-8a8fc300cd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c13b0dd-2fdf-4712-b36a-511d6bc86186', 'volume_name': 'volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b317757-848e-4aa0-bf40-bbaed230728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b317757-848e-4aa0-bf40-bbaed230728f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e02ec04-06f2-46a1-b6df-04ce3bf73001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:51 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Volume 0c13b0dd-2fdf-4712-b36a-511d6bc86186: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Trying to clone 0c13b0dd-2fdf-4712-b36a-511d6bc86186 from image 79b62ee8-86ba-4c65-a753-39d7d038c9fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]). {{(pid=83806) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 10:39:51 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63535613-88b9-4951-99c9-2d432e776363 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c" returned: 0 in 0.738s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:51 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c is being set with open permissions: ugo+rw Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:51 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c Apr 29 10:39:51 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 10:39:51 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Image download 20.69 MB at 20.69 MB/s Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[c786f9f0-c393-4b64-98fa-def601ef76f8]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:51 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD Apr 29 10:39:51 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:51 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c" returned: 0 in 0.697s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:51 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.info Apr 29 10:39:51 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:52 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD" returned: 0 in 0.659s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:52 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Temporary image 79b62ee8-86ba-4c65-a753-39d7d038c9fd is fetched for user e8d30b1e5a064f0780bb2e775e9efe36. {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 10:39:52 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a90941-f83c-4603-bfcc-355b742c7699]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:52 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD Apr 29 10:39:52 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:52 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.info" returned: 0 in 0.640s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:52 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.info is being set with open permissions: ugo+rw Apr 29 10:39:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:52 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.info Apr 29 10:39:52 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:52 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:53 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.info" returned: 0 in 0.621s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.861s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.406s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-246447619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604f2990-963f-4a41-8c3e-e7ac84df9aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2a0e237a394aa997e160d4e0c5ca5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:50Z,use_quota=True,user_id='f532daa47f7c4a658cfe7ef620b829cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Creating volume 604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:39:53 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:53 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 1073741824 Apr 29 10:39:53 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:53 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-838b9057-cf1d-4ec4-a48d-5eed10d4abd1 tempest-VolumesSnapshotTestJSON-897961592 None] Create snapshot completed successfully Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:39:53 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Flow 'volume_create_manager' (999a9c95-5c89-48ec-a91e-b5bb2888c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3cbca7-e39d-41e3-8d7b-218388e4e173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 1073741824" returned: 0 in 0.868s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3cbca7-e39d-41e3-8d7b-218388e4e173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-611130595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bdfe87-6deb-47cd-bc0b-6a0037cd854b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6da507d60748618e9fb9ad685c5c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bfad2279-742f-4783-908d-0b4f659eca2c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:54Z,use_quota=True,user_id='98645aee62014b4b95cc0a80065ebfc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c830a7d6-3bda-47f0-90a2-cdb61863e749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c830a7d6-3bda-47f0-90a2-cdb61863e749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22c61c1-4c27-412d-9ed5-17a67ec87929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22c61c1-4c27-412d-9ed5-17a67ec87929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '46bdfe87-6deb-47cd-bc0b-6a0037cd854b', 'volume_name': 'volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b', 'volume_size': 1, 'snapshot_id': 'bfad2279-742f-4783-908d-0b4f659eca2c'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287ba01c-6409-47b1-9b61-c902f5d92ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287ba01c-6409-47b1-9b61-c902f5d92ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8deb0a8c-344b-4fc8-a404-e2dfae37114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:54 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Volume 46bdfe87-6deb-47cd-bc0b-6a0037cd854b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b', 'volume_size': 1, 'snapshot_id': 'bfad2279-742f-4783-908d-0b4f659eca2c'} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:54 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 Apr 29 10:39:54 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:54 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1" returned: 0 in 0.593s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1148172553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c13b0dd-2fdf-4712-b36a-511d6bc86186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a2e19c69e546b6afc09d12e58a1d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:39:51Z,use_quota=True,user_id='e8d30b1e5a064f0780bb2e775e9efe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Creating volume 0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:39:54 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d1f149-478c-4097-9792-c400513af87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:54 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 1073741824 Apr 29 10:39:54 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a8d595-e6d7-4882-9e49-e50d0f955cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:39:54 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Volume volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 (604f2990-963f-4a41-8c3e-e7ac84df9aa1): created successfully Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a8d595-e6d7-4882-9e49-e50d0f955cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:39:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Flow 'volume_create_manager' (b0f2ae13-8ec6-4d1e-9fe6-4095fe927bda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:39:54 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-fd345bd1-6043-49dc-a226-ac6065fe3e61 tempest-SnapshotDependencyTests-379567457 None] Created volume successfully. Apr 29 10:39:55 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 1073741824" returned: 0 in 0.769s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:55 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 Apr 29 10:39:55 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:56 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186" returned: 0 in 0.682s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.104s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-bfad2279-742f-4783-908d-0b4f659eca2c-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" by "_create_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-bfad2279-742f-4783-908d-0b4f659eca2c-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Creating volume 46bdfe87-6deb-47cd-bc0b-6a0037cd854b from snapshot bfad2279-742f-4783-908d-0b4f659eca2c {{(pid=83806) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Attempting download of 79b62ee8-86ba-4c65-a753-39d7d038c9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}])) to volume 0c13b0dd-2fdf-4712-b36a-511d6bc86186. {{(pid=83806) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] snapshot: bfad2279-742f-4783-908d-0b4f659eca2c, volume: 46bdfe87-6deb-47cd-bc0b-6a0037cd854b, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bf9cf6-f196-4960-bdb3-9066e5654499]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f02d08-0d21-4a73-a534-225fe14ebe5d]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_2dx8anhg {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:56 devstack sudo[91857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c Apr 29 10:39:56 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:56 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_2dx8anhg Apr 29 10:39:56 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:56 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c" returned: 0 in 0.743s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63535613-88b9-4951-99c9-2d432e776363(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:39:56 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_2dx8anhg" returned: 0 in 0.729s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_2dx8anhg {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:57 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b86a37-03e6-460b-8878-dad2eb912d2e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:57 devstack sudo[91866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_2dx8anhg Apr 29 10:39:57 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:57 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 Apr 29 10:39:57 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:57 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_2dx8anhg" returned: 1 in 0.695s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79b62ee8-86ba-4c65-a753-39d7d038c9fd_2dx8anhg' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:39:57 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd435422-4fc0-496c-b9f4-4f8c3cd6f9d7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:39:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:57 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363" returned: 0 in 0.693s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:57 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:39:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:57 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b Apr 29 10:39:57 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:57 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD Apr 29 10:39:57 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:39:58 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Apr 29 10:39:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:39:58 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] 79b62ee8-86ba-4c65-a753-39d7d038c9fd was qcow2, converting to raw {{(pid=83806) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 10:39:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:39:58 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 Apr 29 10:39:58 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:02 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186" returned: 0 in 3.955s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:02 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79b62ee8-86ba-4c65-a753-39d7d038c9fd_6qoi57xsdevstack@QuobyteHD, size 112.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:40:02 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Converted 112.00 MB image at 28.30 MB/s Apr 29 10:40:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:02 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 1G Apr 29 10:40:02 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:02 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" returned: 0 in 4.916s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:02 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc0c49a-e6e9-4520-900c-18153d0156d8]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:02 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 Apr 29 10:40:02 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:03 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 1G" returned: 0 in 0.732s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:03 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[394257a9-760f-44ec-ae9b-ab109de8e469]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:03 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 Apr 29 10:40:03 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:03 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363" returned: 0 in 0.909s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:03 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:40:03 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Converted 1024.00 MB image at 208.27 MB/s Apr 29 10:40:03 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b is being set with open permissions: ugo+rw Apr 29 10:40:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:03 devstack sudo[91923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b Apr 29 10:40:03 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:03 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186" returned: 0 in 0.724s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:03 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 Apr 29 10:40:03 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:04 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" returned: 0 in 0.649s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" released by "_copy_volume_from_snapshot" :: held 8.026s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-bfad2279-742f-4783-908d-0b4f659eca2c-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" released by "_create_volume_from_snapshot" :: held 8.068s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.093s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.119s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Creating offline snapshot c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 of volume 604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8deb0a8c-344b-4fc8-a404-e2dfae37114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b', 'volume_size': 1, 'snapshot_id': 'bfad2279-742f-4783-908d-0b4f659eca2c'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ad69c6-05c3-4716-ba71-ca8b4789a93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9acf9d-574e-4ad2-810f-248fe2e05f07]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:04 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Volume volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b (46bdfe87-6deb-47cd-bc0b-6a0037cd854b): created successfully Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ad69c6-05c3-4716-ba71-ca8b4789a93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Flow 'volume_create_manager' (999a9c95-5c89-48ec-a91e-b5bb2888c780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:04 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7372d222-cac2-434d-b959-c44c0920267b tempest-VolumesSnapshotTestJSON-897961592 None] Created volume successfully. Apr 29 10:40:04 devstack sudo[91931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 Apr 29 10:40:04 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:04 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186" returned: 1 in 0.711s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Downloaded image 79b62ee8-86ba-4c65-a753-39d7d038c9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}])) to volume 0c13b0dd-2fdf-4712-b36a-511d6bc86186 successfully. {{(pid=83806) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Temporary image 79b62ee8-86ba-4c65-a753-39d7d038c9fd for user e8d30b1e5a064f0780bb2e775e9efe36 is deleted. {{(pid=83806) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.volume_utils [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Marking volume 0c13b0dd-2fdf-4712-b36a-511d6bc86186 as bootable. {{(pid=83806) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Copying metadata from image 79b62ee8-86ba-4c65-a753-39d7d038c9fd to 0c13b0dd-2fdf-4712-b36a-511d6bc86186. {{(pid=83806) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Creating volume glance metadata for volume 0c13b0dd-2fdf-4712-b36a-511d6bc86186 backed by image 79b62ee8-86ba-4c65-a753-39d7d038c9fd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83806) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e02ec04-06f2-46a1-b6df-04ce3bf73001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186', 'volume_size': 1, 'image_id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3ae28e5e4be441bbbd9b3389c6fa33ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79b62ee8-86ba-4c65-a753-39d7d038c9fd', 'created_at': datetime.datetime(2026, 4, 29, 8, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79b62ee8-86ba-4c65-a753-39d7d038c9fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9b4d4a-a066-4bba-b2a5-a7ad1e71f87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:04 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Volume volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 (0c13b0dd-2fdf-4712-b36a-511d6bc86186): created successfully Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9b4d4a-a066-4bba-b2a5-a7ad1e71f87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Flow 'volume_create_manager' (bd4cda38-c909-4065-8b6e-8600eeef0101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:04 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-48bd6383-cb93-4d17-aa9b-8438a8421295 tempest-VolumesExtendTest-1041357562 None] Created volume successfully. Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-46bdfe87-6deb-47cd-bc0b-6a0037cd854b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-46bdfe87-6deb-47cd-bc0b-6a0037cd854b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a34bcd-b890-4924-93b0-795f568eda15]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:05 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b Apr 29 10:40:05 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:05 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1" returned: 0 in 0.834s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:05 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 1G Apr 29 10:40:05 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:05 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" returned: 0 in 0.726s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:05 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b Apr 29 10:40:05 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:05 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 1G" returned: 0 in 0.844s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:06 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 Apr 29 10:40:06 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:06 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" returned: 0 in 0.674s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-46bdfe87-6deb-47cd-bc0b-6a0037cd854b" released by "delete_volume" :: held 1.446s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Created reservations ['02226035-4ac4-474c-b33b-6e9aa477f06e', 'a993f08d-2a71-4de7-bc17-6f33c7ea3412', '7734873f-fd3a-448e-8305-85a7f373c500', 'e3106ba4-3339-4ec2-aa95-bf647b0086c0'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:06 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:06 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:06 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50" returned: 0 in 0.684s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:06 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 is being set with open permissions: ugo+rw Apr 29 10:40:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:06 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 Apr 29 10:40:06 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:07 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.632s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:07 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Deleted volume successfully. Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-02f7943e-6298-4740-9879-fdc555e1d09c tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-46bdfe87-6deb-47cd-bc0b-6a0037cd854b-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-bfad2279-742f-4783-908d-0b4f659eca2c-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-bfad2279-742f-4783-908d-0b4f659eca2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-63535613-88b9-4951-99c9-2d432e776363" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-63535613-88b9-4951-99c9-2d432e776363" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-bfad2279-742f-4783-908d-0b4f659eca2c" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-bfad2279-742f-4783-908d-0b4f659eca2c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Deleting offline snapshot bfad2279-742f-4783-908d-0b4f659eca2c of volume 63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] snapshot_file for this snap is: volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:40:07 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50" returned: 0 in 0.638s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5649b11-0911-4677-8597-686f1a38f05c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:07 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.info Apr 29 10:40:07 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:07 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c Apr 29 10:40:07 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:07 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.info" returned: 0 in 0.616s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:07 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.info is being set with open permissions: ugo+rw Apr 29 10:40:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:07 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.info Apr 29 10:40:07 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:08 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c" returned: 0 in 0.782s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63535613-88b9-4951-99c9-2d432e776363(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0e9b12-25b4-4a24-8c4e-965386061699]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:08 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 Apr 29 10:40:08 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:08 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.info" returned: 0 in 0.663s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.411s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.683s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:08 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-27657462-1f98-470e-9344-c49ccc140890 tempest-SnapshotDependencyTests-379567457 None] Create snapshot completed successfully Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[07377e85-9e6a-46df-8611-ce8531f192d9]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:08 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 Apr 29 10:40:08 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:08 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363" returned: 0 in 0.746s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:08 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c Apr 29 10:40:08 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Flow 'volume_create_manager' (289cd167-651f-41fb-9537-71e08300f78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6033d5d7-d216-4ae7-a84b-80441ddbb3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6033d5d7-d216-4ae7-a84b-80441ddbb3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aab2e5a-865a-4c55-9ad4-805ef8521be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2a0e237a394aa997e160d4e0c5ca5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:09Z,use_quota=True,user_id='f532daa47f7c4a658cfe7ef620b829cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae43eea-0779-404e-82b2-254902a4fb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae43eea-0779-404e-82b2-254902a4fb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a068e3-bd4d-4406-a105-5cd767cdaa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a068e3-bd4d-4406-a105-5cd767cdaa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6aab2e5a-865a-4c55-9ad4-805ef8521be5', 'volume_name': 'volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5', 'volume_size': 1, 'snapshot_id': 'c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4700fd95-6b21-4d67-9b88-dfddc6fe94c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4700fd95-6b21-4d67-9b88-dfddc6fe94c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41395c22-e4e9-4389-adcc-a6bc74e72ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:09 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Volume 6aab2e5a-865a-4c55-9ad4-805ef8521be5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5', 'volume_size': 1, 'snapshot_id': 'c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50'} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:09 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186" returned: 0 in 0.861s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:09 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c" returned: 0 in 0.766s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:09 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 Apr 29 10:40:09 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c Apr 29 10:40:09 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:09 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:10 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:10 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186" returned: 1 in 0.729s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 2G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363.bfad2279-742f-4783-908d-0b4f659eca2c" returned: 0 in 0.660s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-bfad2279-742f-4783-908d-0b4f659eca2c" released by "_delete_snapshot" :: held 3.098s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-63535613-88b9-4951-99c9-2d432e776363" released by "delete_snapshot" :: held 3.125s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 2G" returned: 0 in 0.101s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.747s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.883s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "cinder-quobyte-c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50-6aab2e5a-865a-4c55-9ad4-805ef8521be5" by "_create_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50-6aab2e5a-865a-4c55-9ad4-805ef8521be5" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Creating volume 6aab2e5a-865a-4c55-9ad4-805ef8521be5 from snapshot c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 {{(pid=83806) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "cinder-quobyte-6aab2e5a-865a-4c55-9ad4-805ef8521be5" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-6aab2e5a-865a-4c55-9ad4-805ef8521be5" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] snapshot: c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50, volume: 6aab2e5a-865a-4c55-9ad4-805ef8521be5, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:40:10 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9ae432dc-9673-48e7-b8a9-5ce89ef54e0c tempest-VolumesExtendTest-1041357562 None] Extend volume completed successfully. Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Created reservations ['fa4bc7d6-2286-4056-af0e-a19c833083a7', 'ed16fda5-f22f-4cd3-92ce-c8490118588b', 'ded3c771-674f-4618-b5ab-96e38b887eb9', '48aa8002-e8e6-46af-9a35-166bf6b0ee52'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3b65c8-f0ca-46be-892f-0971c898f945]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:10 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Delete snapshot completed successfully. Apr 29 10:40:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-745f0dc2-4ca2-49aa-a98a-2217c70cc052 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-bfad2279-742f-4783-908d-0b4f659eca2c-delete_snapshot" released by "delete_snapshot" :: held 3.357s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:10 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 Apr 29 10:40:10 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:11 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50" returned: 0 in 0.720s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a2d31c-6ae9-4f03-ae9f-335f7af64282]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:11 devstack sudo[92008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 Apr 29 10:40:11 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-63535613-88b9-4951-99c9-2d432e776363-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-63535613-88b9-4951-99c9-2d432e776363-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Acquiring lock "cinder-0c13b0dd-2fdf-4712-b36a-511d6bc86186-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Lock "cinder-0c13b0dd-2fdf-4712-b36a-511d6bc86186-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-63535613-88b9-4951-99c9-2d432e776363" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-63535613-88b9-4951-99c9-2d432e776363" acquired by "delete_volume" :: waited 0.027s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Acquiring lock "cinder-quobyte-0c13b0dd-2fdf-4712-b36a-511d6bc86186" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59486f7-bb98-49ff-84e5-83b407ca95a9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Lock "cinder-quobyte-0c13b0dd-2fdf-4712-b36a-511d6bc86186" acquired by "delete_volume" :: waited 0.031s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3b6a2-d6a4-4a9e-baf7-000b86aa5196]: (4, 'raw') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:11 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 Apr 29 10:40:11 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:11 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 Apr 29 10:40:11 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:12 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1" returned: 0 in 0.853s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:12 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:40:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:12 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 Apr 29 10:40:12 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:12 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363" returned: 0 in 0.768s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:12 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363 Apr 29 10:40:12 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:12 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186" returned: 0 in 0.745s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:12 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 Apr 29 10:40:12 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:13 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-63535613-88b9-4951-99c9-2d432e776363" returned: 0 in 0.849s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-63535613-88b9-4951-99c9-2d432e776363" released by "delete_volume" :: held 1.716s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=125,cinder:INSERT=35,cinder:SELECT=94,cinder:DELETE=13 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Created reservations ['b2cd2ddc-e669-44a0-9cec-31b02d01b6c7', 'ed79f6d3-310c-4770-ac20-ee68d8c26a7b', 'e63e55b2-74c1-41a0-b17e-a043273da3ea', '414fe8cb-2882-443f-8f95-3a86bbac03ad'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:13 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186" returned: 1 in 1.139s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186' failed. Not Retrying. {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:13 devstack sudo[92043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186 Apr 29 10:40:13 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:13 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:13 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-5e497b66-78e5-4f8c-a576-93f5e0b35dfc-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-5e497b66-78e5-4f8c-a576-93f5e0b35dfc-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "cinder-quobyte-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" acquired by "delete_volume" :: waited 0.049s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:14 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d67f072-da67-4588-bb6a-a2889a547ef3]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:14 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc Apr 29 10:40:14 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:14 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.241s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:15 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Deleted volume successfully. Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-861ae108-49d2-4218-8dba-4c64668d6463 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-63535613-88b9-4951-99c9-2d432e776363-delete_volume" released by "delete_volume" :: held 3.529s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:15 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0c13b0dd-2fdf-4712-b36a-511d6bc86186" returned: 0 in 1.801s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Lock "cinder-quobyte-0c13b0dd-2fdf-4712-b36a-511d6bc86186" released by "delete_volume" :: held 3.780s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=124,cinder:SELECT=110,cinder:DELETE=9,cinder:INSERT=35 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Created reservations ['7550cb77-a406-40fe-b9c0-05a35125476e', 'a192fe79-de5f-4ac7-91c4-59c396219c5c', 'e49b3e4c-c8ac-45a7-a960-16085475a8c8', 'a134c10f-4918-4272-be1f-588e1f34afec'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:15 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:15 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:16 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" returned: 0 in 2.047s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:16 devstack sudo[92058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc Apr 29 10:40:16 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Flow 'volume_create_manager' (e8cfbe1d-a40a-4d9c-b661-6aa7f9e3bd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd45b3d9-d034-4139-8195-c24e2839d70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:17 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.695s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd45b3d9-d034-4139-8195-c24e2839d70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1342668810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b0a4ba-6aa4-4baf-8293-70b893e33420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a2e19c69e546b6afc09d12e58a1d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:17Z,use_quota=True,user_id='e8d30b1e5a064f0780bb2e775e9efe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c67cae7-e7b5-4822-b87f-676ef1d54d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c67cae7-e7b5-4822-b87f-676ef1d54d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8501834-b41f-4913-9d18-ba902cf277f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8501834-b41f-4913-9d18-ba902cf277f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b0a4ba-6aa4-4baf-8293-70b893e33420', 'volume_name': 'volume-52b0a4ba-6aa4-4baf-8293-70b893e33420', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c070565b-f2b9-444c-b322-d5f59d9270c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c070565b-f2b9-444c-b322-d5f59d9270c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77807972-f431-4e20-83ac-445cd566b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:17 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Volume 52b0a4ba-6aa4-4baf-8293-70b893e33420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b0a4ba-6aa4-4baf-8293-70b893e33420', 'volume_size': 1} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:17 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Deleted volume successfully. Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c30faa8b-dda3-4c09-92c7-d0ca7277398f tempest-VolumesExtendTest-1041357562 None] Lock "cinder-0c13b0dd-2fdf-4712-b36a-511d6bc86186-delete_volume" released by "delete_volume" :: held 6.013s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:17 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" returned: 0 in 1.125s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-quobyte-5e497b66-78e5-4f8c-a576-93f5e0b35dfc" released by "delete_volume" :: held 3.346s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:17 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Created reservations ['2db75832-90cf-4279-afa8-93cb8e0790ca', '47f54c02-96e2-4d30-b6d5-6ad3221c5cd1', '9f4e67f2-26e3-4764-ae39-02ec42278fd3', '4811513d-5d75-4dc1-a424-bd8839ee9be8'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:18 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:18 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:18 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5" returned: 0 in 6.245s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bf98f3-206d-4b32-bb6b-5de0ce1b9eb7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:18 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 Apr 29 10:40:18 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:18 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.659s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:18 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Deleted volume successfully. Apr 29 10:40:18 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3bf821f1-119a-4a61-bc0f-ec7d29eb3e59 tempest-VolumesSnapshotTestJSON-897961592 None] Lock "cinder-5e497b66-78e5-4f8c-a576-93f5e0b35dfc-delete_volume" released by "delete_volume" :: held 4.563s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:19 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1" returned: 0 in 0.874s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:40:19 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Converted 1024.00 MB image at 163.94 MB/s Apr 29 10:40:19 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 is being set with open permissions: ugo+rw Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:19 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 Apr 29 10:40:19 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:19 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5" returned: 0 in 0.590s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-6aab2e5a-865a-4c55-9ad4-805ef8521be5" released by "_copy_volume_from_snapshot" :: held 9.392s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50-6aab2e5a-865a-4c55-9ad4-805ef8521be5" released by "_create_volume_from_snapshot" :: held 9.430s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.456s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.217s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1342668810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b0a4ba-6aa4-4baf-8293-70b893e33420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a2e19c69e546b6afc09d12e58a1d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:17Z,use_quota=True,user_id='e8d30b1e5a064f0780bb2e775e9efe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Creating volume 52b0a4ba-6aa4-4baf-8293-70b893e33420 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:40:19 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:19 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 1073741824 Apr 29 10:40:19 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41395c22-e4e9-4389-adcc-a6bc74e72ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5', 'volume_size': 1, 'snapshot_id': 'c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc970551-78bf-4ad1-91b5-d3728ac04ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:19 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Volume volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 (6aab2e5a-865a-4c55-9ad4-805ef8521be5): created successfully Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc970551-78bf-4ad1-91b5-d3728ac04ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Flow 'volume_create_manager' (289cd167-651f-41fb-9537-71e08300f78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-303aab9c-09dc-403c-9d91-88946a66d63b tempest-SnapshotDependencyTests-379567457 None] Created volume successfully. Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "cinder-c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "cinder-quobyte-604f2990-963f-4a41-8c3e-e7ac84df9aa1" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-604f2990-963f-4a41-8c3e-e7ac84df9aa1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "cinder-quobyte-c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Deleting offline snapshot c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 of volume 604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:40:20 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] snapshot_file for this snap is: volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 1073741824" returned: 0 in 0.887s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d00f977-fcd9-48e4-ad95-c8d23b949bea]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:20 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 Apr 29 10:40:20 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:20 devstack sudo[92080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 Apr 29 10:40:20 devstack sudo[92080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:21 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420" returned: 0 in 0.667s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77807972-f431-4e20-83ac-445cd566b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b0a4ba-6aa4-4baf-8293-70b893e33420', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e96a67-51fd-4a23-91b4-64932986fd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:21 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Volume volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 (52b0a4ba-6aa4-4baf-8293-70b893e33420): created successfully Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e96a67-51fd-4a23-91b4-64932986fd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Flow 'volume_create_manager' (e8cfbe1d-a40a-4d9c-b661-6aa7f9e3bd77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:21 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7982793f-b440-4a2a-b59e-feb2e5ba2ebc tempest-VolumesExtendTest-1041357562 None] Created volume successfully. Apr 29 10:40:21 devstack sudo[92080]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50" returned: 0 in 0.757s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0509f-115b-406a-836b-39bcbcc3551a]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:21 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 Apr 29 10:40:21 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Creating offline snapshot 7bf32d3b-eda3-4429-803c-687c16b560a3 of volume 52b0a4ba-6aa4-4baf-8293-70b893e33420 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:40:22 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8745caf-89f7-4fba-8a22-f42486766845]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:22 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 Apr 29 10:40:22 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:22 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1" returned: 0 in 0.919s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:22 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 Apr 29 10:40:22 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:22 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420" returned: 0 in 0.713s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:22 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 1G Apr 29 10:40:22 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:23 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50" returned: 0 in 0.840s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:23 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50 Apr 29 10:40:23 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:23 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 1G" returned: 0 in 0.907s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:23 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 Apr 29 10:40:23 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:23 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1.c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50" returned: 0 in 0.635s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50" released by "_delete_snapshot" :: held 3.304s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-604f2990-963f-4a41-8c3e-e7ac84df9aa1" released by "delete_snapshot" :: held 3.335s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Created reservations ['63e70276-2d59-4162-9606-cbf8ca3ee323', '5d3b09fd-ffdf-4b89-92aa-31be3536a234', 'b867740a-25d9-408e-89f7-0e16997733b0', 'f4928460-e0ec-48b5-996c-3d140029b204'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:24 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Delete snapshot completed successfully. Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-872d1df6-8851-4146-bdba-773b138c6601 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-c31bbf8b-3e2e-4d33-9ec0-b270fcfecb50-delete_snapshot" released by "delete_snapshot" :: held 3.486s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:24 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3" returned: 0 in 0.704s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:24 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 is being set with open permissions: ugo+rw Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:24 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 Apr 29 10:40:24 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Flow 'volume_create_manager' (d83bffac-c45b-4956-bf2a-0ed2112c6a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed364527-e424-45af-9931-bd1dadb357e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed364527-e424-45af-9931-bd1dadb357e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5480bd-d4f9-49b2-b265-ce19c9401ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207fe95ec7304e888390150e45efd9bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:25Z,use_quota=True,user_id='1021770b765041fc947093d4b8472547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66cc1ca-1ced-4f56-b34b-6de64a0a24af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66cc1ca-1ced-4f56-b34b-6de64a0a24af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5276be5-3b7b-4f26-9589-dd19f938b157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5276be5-3b7b-4f26-9589-dd19f938b157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5480bd-d4f9-49b2-b265-ce19c9401ea9', 'volume_name': 'volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43efd6ba-89d6-452f-a45c-ba16f81e8c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43efd6ba-89d6-452f-a45c-ba16f81e8c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee54924-1d7f-47a3-adf1-575b2d539baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:24 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Volume 0b5480bd-d4f9-49b2-b265-ce19c9401ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9', 'volume_size': 1} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "cinder-604f2990-963f-4a41-8c3e-e7ac84df9aa1-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-604f2990-963f-4a41-8c3e-e7ac84df9aa1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "cinder-quobyte-604f2990-963f-4a41-8c3e-e7ac84df9aa1" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:24 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-604f2990-963f-4a41-8c3e-e7ac84df9aa1" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:25 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3" returned: 0 in 0.678s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:25 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb68349-1d3c-413c-ae13-30b3d8202d7f]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:25 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.info Apr 29 10:40:25 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:25 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 Apr 29 10:40:25 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:25 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.info" returned: 0 in 0.596s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:25 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.info is being set with open permissions: ugo+rw Apr 29 10:40:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:25 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.info Apr 29 10:40:25 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:25 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1" returned: 0 in 0.776s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:25 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1 Apr 29 10:40:25 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:26 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.info" returned: 0 in 0.636s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.352s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5480bd-d4f9-49b2-b265-ce19c9401ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207fe95ec7304e888390150e45efd9bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:25Z,use_quota=True,user_id='1021770b765041fc947093d4b8472547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Creating volume 0b5480bd-d4f9-49b2-b265-ce19c9401ea9 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:40:26 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:26 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9 1073741824 Apr 29 10:40:26 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:26 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4ddf8558-1135-4d2b-97bc-5f24da6c46f1 tempest-VolumesExtendTest-1041357562 None] Create snapshot completed successfully Apr 29 10:40:26 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-604f2990-963f-4a41-8c3e-e7ac84df9aa1" returned: 0 in 0.653s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-604f2990-963f-4a41-8c3e-e7ac84df9aa1" released by "delete_volume" :: held 1.506s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Created reservations ['6c303dfd-1835-4585-b6b3-64ef8cbdbe35', '8fe31608-4b19-4b32-b248-b9f2d3def00e', 'd2d26b79-79c8-4cfb-b912-2e367bb91f12', '729242f1-508e-4777-94f1-655b945950fe'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:26 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:26 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "cinder-6aab2e5a-865a-4c55-9ad4-805ef8521be5-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:27 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9 1073741824" returned: 0 in 0.849s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-6aab2e5a-865a-4c55-9ad4-805ef8521be5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "cinder-quobyte-6aab2e5a-865a-4c55-9ad4-805ef8521be5" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:27 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9 Apr 29 10:40:27 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-6aab2e5a-865a-4c55-9ad4-805ef8521be5" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e63c2870-7568-4864-9b13-feb7fa2c63b8 tempest-VolumesExtendTest-1041357562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e23818-2341-45a8-8e59-0b5076a15b6d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:27 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.790s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:27 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Deleted volume successfully. Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ebe741b7-b76a-46e3-be00-735c07035357 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-604f2990-963f-4a41-8c3e-e7ac84df9aa1-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:27 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 Apr 29 10:40:27 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:27 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9" returned: 0 in 0.682s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e63c2870-7568-4864-9b13-feb7fa2c63b8 tempest-VolumesExtendTest-1041357562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.603s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee54924-1d7f-47a3-adf1-575b2d539baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfc7bfa-5342-465f-a3ad-6229508664f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc6e846-4c5f-4ef4-b805-19dbdd3f895c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e63c2870-7568-4864-9b13-feb7fa2c63b8 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:28 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Volume volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9 (0b5480bd-d4f9-49b2-b265-ce19c9401ea9): created successfully Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfc7bfa-5342-465f-a3ad-6229508664f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Flow 'volume_create_manager' (d83bffac-c45b-4956-bf2a-0ed2112c6a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:28 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-c0b15efb-861f-4737-ad42-e646653ae160 tempest-CinderUnicodeTest-196453768 None] Created volume successfully. Apr 29 10:40:28 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 Apr 29 10:40:28 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:28 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5" returned: 0 in 0.809s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:28 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5 Apr 29 10:40:28 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:28 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e63c2870-7568-4864-9b13-feb7fa2c63b8 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420" returned: 0 in 0.771s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:28 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e63c2870-7568-4864-9b13-feb7fa2c63b8 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 2G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6aab2e5a-865a-4c55-9ad4-805ef8521be5" returned: 0 in 0.613s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-quobyte-6aab2e5a-865a-4c55-9ad4-805ef8521be5" released by "delete_volume" :: held 1.490s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Created reservations ['c9c126da-48d5-4066-85cb-5c102cfacafa', '4c1c9f08-c681-489d-88f1-fcb81153f0c5', '64d2f0da-8be4-47d3-a710-130993c5b7c8', '19c1d8ad-f7f4-4c54-bda4-30d6d3ecf172'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e63c2870-7568-4864-9b13-feb7fa2c63b8 tempest-VolumesExtendTest-1041357562 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 2G" returned: 0 in 0.132s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e63c2870-7568-4864-9b13-feb7fa2c63b8 tempest-VolumesExtendTest-1041357562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.955s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:28 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e63c2870-7568-4864-9b13-feb7fa2c63b8 tempest-VolumesExtendTest-1041357562 None] Extend volume completed successfully. Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:29 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:29 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Flow 'volume_create_manager' (79a82cd0-c868-408a-8805-85c544256e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171fe6ec-a5cf-420f-a17c-05271f53cd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171fe6ec-a5cf-420f-a17c-05271f53cd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1278542026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c69dcb7-90f8-46df-9983-fb980624dada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207fe95ec7304e888390150e45efd9bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:29Z,use_quota=True,user_id='1021770b765041fc947093d4b8472547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d04266-af47-415a-b5f7-30713519ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d04266-af47-415a-b5f7-30713519ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b38f88-9dd4-4e00-bb29-95e6d91a5138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b38f88-9dd4-4e00-bb29-95e6d91a5138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c69dcb7-90f8-46df-9983-fb980624dada', 'volume_name': 'volume-1c69dcb7-90f8-46df-9983-fb980624dada', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4350d71-4e36-4e85-9e84-be81b3c70afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4350d71-4e36-4e85-9e84-be81b3c70afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d31ba6-593b-47ec-a7b1-e40972525694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:29 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Volume 1c69dcb7-90f8-46df-9983-fb980624dada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c69dcb7-90f8-46df-9983-fb980624dada', 'volume_size': 1} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1278542026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c69dcb7-90f8-46df-9983-fb980624dada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207fe95ec7304e888390150e45efd9bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:29Z,use_quota=True,user_id='1021770b765041fc947093d4b8472547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Creating volume 1c69dcb7-90f8-46df-9983-fb980624dada {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:40:29 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:29 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:29 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada 1073741824 Apr 29 10:40:29 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.675s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Deleted volume successfully. Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Acquiring lock "cinder-7bf32d3b-eda3-4429-803c-687c16b560a3-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8f159b00-1c89-4eca-a7ec-14700bdc5a65 tempest-SnapshotDependencyTests-379567457 None] Lock "cinder-6aab2e5a-865a-4c55-9ad4-805ef8521be5-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Lock "cinder-7bf32d3b-eda3-4429-803c-687c16b560a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Acquiring lock "cinder-quobyte-52b0a4ba-6aa4-4baf-8293-70b893e33420" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Lock "cinder-quobyte-52b0a4ba-6aa4-4baf-8293-70b893e33420" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Acquiring lock "cinder-quobyte-7bf32d3b-eda3-4429-803c-687c16b560a3" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Lock "cinder-quobyte-7bf32d3b-eda3-4429-803c-687c16b560a3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Deleting offline snapshot 7bf32d3b-eda3-4429-803c-687c16b560a3 of volume 52b0a4ba-6aa4-4baf-8293-70b893e33420 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] snapshot_file for this snap is: volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[712d6094-0424-4885-9a7c-4f8cb1ed5a51]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:29 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 Apr 29 10:40:29 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:30 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada 1073741824" returned: 0 in 0.918s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:30 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3" returned: 0 in 0.786s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b0a4ba-6aa4-4baf-8293-70b893e33420(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:40:30 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada Apr 29 10:40:30 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:30 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[04afc2f6-07eb-41ad-82dd-6e9471facab2]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:30 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 Apr 29 10:40:30 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:31 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada" returned: 0 in 0.681s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d31ba6-593b-47ec-a7b1-e40972525694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c69dcb7-90f8-46df-9983-fb980624dada', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22de67f-cb38-4f7a-ae39-99e0ea296ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:31 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Volume volume-1c69dcb7-90f8-46df-9983-fb980624dada (1c69dcb7-90f8-46df-9983-fb980624dada): created successfully Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22de67f-cb38-4f7a-ae39-99e0ea296ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Flow 'volume_create_manager' (79a82cd0-c868-408a-8805-85c544256e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:31 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b7bfa493-dea1-49e7-a95a-50ef9278f466 tempest-CinderUnicodeTest-196453768 None] Created volume successfully. Apr 29 10:40:31 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420" returned: 0 in 0.812s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:31 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 Apr 29 10:40:31 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Creating offline snapshot 9fc38ac4-bd66-4bf3-ba3e-d2910330e08f of volume 1c69dcb7-90f8-46df-9983-fb980624dada {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce74f02-1d87-4219-9d09-4a26ef5cce72]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:32 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada Apr 29 10:40:32 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:32 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3" returned: 0 in 0.772s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:32 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3 Apr 29 10:40:32 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:32 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada" returned: 0 in 0.874s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:32 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f 1G Apr 29 10:40:32 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:32 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420.7bf32d3b-eda3-4429-803c-687c16b560a3" returned: 0 in 0.705s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Lock "cinder-quobyte-7bf32d3b-eda3-4429-803c-687c16b560a3" released by "_delete_snapshot" :: held 3.216s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Lock "cinder-quobyte-52b0a4ba-6aa4-4baf-8293-70b893e33420" released by "delete_snapshot" :: held 3.242s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Created reservations ['3a732c66-6120-410b-a1a9-faab7d674c03', '28555f87-72f7-4380-bc77-c2e3623b26e8', '8f569e75-c117-4229-b810-80073e7e7cff', '4ceef5cb-7d4f-4465-a7a2-8f3f0f5747d9'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:33 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Delete snapshot completed successfully. Apr 29 10:40:33 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:33 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-7a826733-e494-40bc-b78c-c971044f5f29 tempest-VolumesExtendTest-1041357562 None] Lock "cinder-7bf32d3b-eda3-4429-803c-687c16b560a3-delete_snapshot" released by "delete_snapshot" :: held 3.428s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:33 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f 1G" returned: 0 in 0.819s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c69dcb7-90f8-46df-9983-fb980624dada -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:33 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c69dcb7-90f8-46df-9983-fb980624dada -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f Apr 29 10:40:33 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:33 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.653s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Acquiring lock "cinder-52b0a4ba-6aa4-4baf-8293-70b893e33420-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Lock "cinder-52b0a4ba-6aa4-4baf-8293-70b893e33420-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Acquiring lock "cinder-quobyte-52b0a4ba-6aa4-4baf-8293-70b893e33420" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Lock "cinder-quobyte-52b0a4ba-6aa4-4baf-8293-70b893e33420" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:34 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c6321b-843d-4781-ae95-2baf9f046033]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:34 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 Apr 29 10:40:34 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:34 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c69dcb7-90f8-46df-9983-fb980624dada -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f" returned: 0 in 0.794s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:34 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f is being set with open permissions: ugo+rw Apr 29 10:40:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:34 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f Apr 29 10:40:34 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:35 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420" returned: 0 in 0.815s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:35 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420 Apr 29 10:40:35 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:35 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f" returned: 0 in 0.708s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:35 devstack sudo[92226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.info Apr 29 10:40:35 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:35 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-52b0a4ba-6aa4-4baf-8293-70b893e33420" returned: 0 in 0.598s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Lock "cinder-quobyte-52b0a4ba-6aa4-4baf-8293-70b893e33420" released by "delete_volume" :: held 1.510s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Created reservations ['8409f186-7e99-489d-aaee-dcc57700295a', '6d4d67d0-9ca8-41b3-91c1-f48fa44937c8', 'f4b5518c-36dd-4775-b9b9-fb9a779135fc', 'e94c8ec2-862d-4863-859a-99ed28d87208'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:35 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.info" returned: 0 in 0.657s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:35 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.info is being set with open permissions: ugo+rw Apr 29 10:40:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:35 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:35 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:35 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.info Apr 29 10:40:35 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:36 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.657s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:36 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:36 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Deleted volume successfully. Apr 29 10:40:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3cb34a02-5f41-4ce8-aad9-0eb3d31006b1 tempest-VolumesExtendTest-1041357562 None] Lock "cinder-52b0a4ba-6aa4-4baf-8293-70b893e33420-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:36 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.info" returned: 0 in 0.822s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.780s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:36 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7ba4ea0b-9e6e-4ed3-83a7-6ab38221d8fd tempest-CinderUnicodeTest-196453768 None] Create snapshot completed successfully Apr 29 10:40:37 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Acquiring lock "cinder-9fc38ac4-bd66-4bf3-ba3e-d2910330e08f-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:37 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Lock "cinder-9fc38ac4-bd66-4bf3-ba3e-d2910330e08f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:37 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Acquiring lock "cinder-quobyte-1c69dcb7-90f8-46df-9983-fb980624dada" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:37 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Lock "cinder-quobyte-1c69dcb7-90f8-46df-9983-fb980624dada" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:37 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Acquiring lock "cinder-quobyte-9fc38ac4-bd66-4bf3-ba3e-d2910330e08f" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:37 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Lock "cinder-quobyte-9fc38ac4-bd66-4bf3-ba3e-d2910330e08f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Deleting offline snapshot 9fc38ac4-bd66-4bf3-ba3e-d2910330e08f of volume 1c69dcb7-90f8-46df-9983-fb980624dada {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:40:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] snapshot_file for this snap is: volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:40:37 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[e658ca6d-cd57-441d-8913-5e62c87af669]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:37 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f Apr 29 10:40:37 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:38 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f" returned: 0 in 0.813s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c69dcb7-90f8-46df-9983-fb980624dada(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:40:38 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dc68de-1a8b-4b97-affc-0fe071dc23a9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:38 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada Apr 29 10:40:38 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:38 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada" returned: 0 in 0.782s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:38 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f Apr 29 10:40:38 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:39 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f" returned: 0 in 0.716s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:39 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f Apr 29 10:40:39 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:40 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada.9fc38ac4-bd66-4bf3-ba3e-d2910330e08f" returned: 0 in 0.605s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:40 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Lock "cinder-quobyte-9fc38ac4-bd66-4bf3-ba3e-d2910330e08f" released by "_delete_snapshot" :: held 3.050s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:40 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Lock "cinder-quobyte-1c69dcb7-90f8-46df-9983-fb980624dada" released by "delete_snapshot" :: held 3.074s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:40 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Created reservations ['a698aaa4-2827-41c0-a5a3-a58670763132', '4e0fa3bd-cbfe-4677-a9f4-fe25623c72e6', 'd44f162f-fa0d-4e03-a0c2-03d5fae5d78f', 'f1bde300-8f7d-40a8-9eb6-7ba47bb5ae26'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:40 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Delete snapshot completed successfully. Apr 29 10:40:40 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b5872c47-946e-4e9d-958b-c858572e1aae tempest-CinderUnicodeTest-196453768 None] Lock "cinder-9fc38ac4-bd66-4bf3-ba3e-d2910330e08f-delete_snapshot" released by "delete_snapshot" :: held 3.280s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Acquiring lock "cinder-1c69dcb7-90f8-46df-9983-fb980624dada-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Lock "cinder-1c69dcb7-90f8-46df-9983-fb980624dada-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Acquiring lock "cinder-quobyte-1c69dcb7-90f8-46df-9983-fb980624dada" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Lock "cinder-quobyte-1c69dcb7-90f8-46df-9983-fb980624dada" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f15c32-6342-41b5-9ba2-3279c62b576a]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:41 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada Apr 29 10:40:41 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (aaebeb29-f37b-423a-a988-c710e4d85cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b41b16-3a42-408f-b376-c894f7cfc818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b41b16-3a42-408f-b376-c894f7cfc818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-540015458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc76ecd-9973-47ba-9018-294f3c24b215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:42Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29cbbfb-1785-47be-917b-d66e121dc804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29cbbfb-1785-47be-917b-d66e121dc804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502a4cb8-8c87-4167-a376-5228e7ce9db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502a4cb8-8c87-4167-a376-5228e7ce9db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc76ecd-9973-47ba-9018-294f3c24b215', 'volume_name': 'volume-7fc76ecd-9973-47ba-9018-294f3c24b215', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e34431-11a9-4e67-b3c6-c11871497727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e34431-11a9-4e67-b3c6-c11871497727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37d3de3-b575-4ec0-ad90-173b6ee2c7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:41 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume 7fc76ecd-9973-47ba-9018-294f3c24b215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc76ecd-9973-47ba-9018-294f3c24b215', 'volume_size': 1} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-540015458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc76ecd-9973-47ba-9018-294f3c24b215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:42Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Creating volume 7fc76ecd-9973-47ba-9018-294f3c24b215 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:40:41 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:40:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:41 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 1073741824 Apr 29 10:40:41 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:42 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada" returned: 0 in 0.710s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:42 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada Apr 29 10:40:42 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:42 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 1073741824" returned: 0 in 0.763s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:42 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 Apr 29 10:40:42 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:42 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-1c69dcb7-90f8-46df-9983-fb980624dada" returned: 0 in 0.643s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:42 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Lock "cinder-quobyte-1c69dcb7-90f8-46df-9983-fb980624dada" released by "delete_volume" :: held 1.415s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:42 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Created reservations ['deb2a011-c542-4dcb-9db7-435f06499afd', '32659692-1998-42ba-8ff2-ad6b73d5cfb9', '7137be29-02ea-48bc-873b-6f53e3e1b347', '36d04293-71a8-49a1-a51e-61e6e156bad4'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:43 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:43 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:43 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215" returned: 0 in 0.582s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37d3de3-b575-4ec0-ad90-173b6ee2c7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc76ecd-9973-47ba-9018-294f3c24b215', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f38a4fa-de44-410f-aa5e-cea45c2bb3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:43 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume volume-7fc76ecd-9973-47ba-9018-294f3c24b215 (7fc76ecd-9973-47ba-9018-294f3c24b215): created successfully Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f38a4fa-de44-410f-aa5e-cea45c2bb3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (aaebeb29-f37b-423a-a988-c710e4d85cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:43 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-302143fb-8b63-4a78-b5f3-c7efb1a45715 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created volume successfully. Apr 29 10:40:43 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.597s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:43 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Deleted volume successfully. Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-11e39abd-8bb7-410d-a175-f7711d3c9f5c tempest-CinderUnicodeTest-196453768 None] Lock "cinder-1c69dcb7-90f8-46df-9983-fb980624dada-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Acquiring lock "cinder-0b5480bd-d4f9-49b2-b265-ce19c9401ea9-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Lock "cinder-0b5480bd-d4f9-49b2-b265-ce19c9401ea9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Acquiring lock "cinder-quobyte-0b5480bd-d4f9-49b2-b265-ce19c9401ea9" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Lock "cinder-quobyte-0b5480bd-d4f9-49b2-b265-ce19c9401ea9" acquired by "delete_volume" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[33318a96-806d-48e5-b275-16d4da0e3e30]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:43 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9 Apr 29 10:40:43 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Creating offline snapshot 1dfd302a-fb82-4290-b494-14020d0fbfe3 of volume 7fc76ecd-9973-47ba-9018-294f3c24b215 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:40:44 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f3e108-63af-412e-8769-1233cd70754b]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:44 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 Apr 29 10:40:44 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:44 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9" returned: 0 in 0.697s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:44 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9 Apr 29 10:40:44 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:44 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215" returned: 0 in 0.748s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:44 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 1G Apr 29 10:40:44 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:45 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0b5480bd-d4f9-49b2-b265-ce19c9401ea9" returned: 0 in 0.595s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Lock "cinder-quobyte-0b5480bd-d4f9-49b2-b265-ce19c9401ea9" released by "delete_volume" :: held 1.337s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Created reservations ['44b216d0-eb64-4010-8642-f9b1c63f8fc3', '5741a0de-2a6f-46c3-88e1-d1c226eb953f', '5b586a05-d88b-47b3-89d3-f332867c7940', '34f74bc0-3466-46a2-b40d-0e09616e5456'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:45 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:45 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:45 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 1G" returned: 0 in 0.774s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc76ecd-9973-47ba-9018-294f3c24b215 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:45 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc76ecd-9973-47ba-9018-294f3c24b215 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 Apr 29 10:40:45 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:45 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.575s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:45 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Deleted volume successfully. Apr 29 10:40:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-12797f52-06e5-4d12-a06a-76012f18e4a9 tempest-CinderUnicodeTest-196453768 None] Lock "cinder-0b5480bd-d4f9-49b2-b265-ce19c9401ea9-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:46 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc76ecd-9973-47ba-9018-294f3c24b215 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3" returned: 0 in 0.648s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:46 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 is being set with open permissions: ugo+rw Apr 29 10:40:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:46 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 Apr 29 10:40:46 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:46 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3" returned: 0 in 0.609s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:46 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.info Apr 29 10:40:46 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:47 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.info" returned: 0 in 0.591s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:47 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.info is being set with open permissions: ugo+rw Apr 29 10:40:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:47 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.info Apr 29 10:40:47 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:48 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.info" returned: 0 in 0.561s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.018s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:48 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-ddbb0b2a-3d9e-44d9-a8fb-08becd7f69ad tempest-CreateVolumesFromSnapshotTest-180180585 None] Create snapshot completed successfully Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (411888d7-131a-485a-8545-3ce5c6685b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0ccca1-5a46-4540-b4b8-46def080d377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0ccca1-5a46-4540-b4b8-46def080d377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1356606613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc3c28c-4ae4-4872-ba54-170418a58c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:49Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9187dd53-8e9d-4937-98ab-6503f83b1326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9187dd53-8e9d-4937-98ab-6503f83b1326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b44683b-8988-4328-8893-2ae72af749b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b44683b-8988-4328-8893-2ae72af749b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc3c28c-4ae4-4872-ba54-170418a58c00', 'volume_name': 'volume-9cc3c28c-4ae4-4872-ba54-170418a58c00', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1386de1b-2465-4a13-a37f-c64203ee49b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1386de1b-2465-4a13-a37f-c64203ee49b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040eec6c-bea8-4483-9438-504fbb2a2925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:48 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume 9cc3c28c-4ae4-4872-ba54-170418a58c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc3c28c-4ae4-4872-ba54-170418a58c00', 'volume_size': 1} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1356606613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc3c28c-4ae4-4872-ba54-170418a58c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:49Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Creating volume 9cc3c28c-4ae4-4872-ba54-170418a58c00 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:40:48 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:48 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00 1073741824 Apr 29 10:40:48 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (6c833d99-ce25-402e-bb44-1f58350af919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7215ce98-456d-4431-a89e-87d9ec094b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7215ce98-456d-4431-a89e-87d9ec094b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2129597621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d8393b-da9c-4b55-b444-77d8c2c934ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:49Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f71113-609b-426b-bad6-8196a7ea3edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f71113-609b-426b-bad6-8196a7ea3edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2b118a-cf18-4f66-883e-824b49026312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:48 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2b118a-cf18-4f66-883e-824b49026312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d8393b-da9c-4b55-b444-77d8c2c934ac', 'volume_name': 'volume-39d8393b-da9c-4b55-b444-77d8c2c934ac', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b914175-4a1f-499b-8dab-455c9f1a8e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b914175-4a1f-499b-8dab-455c9f1a8e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76fa61b-326e-4c1c-a35e-c9dfbc3120c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume 39d8393b-da9c-4b55-b444-77d8c2c934ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d8393b-da9c-4b55-b444-77d8c2c934ac', 'volume_size': 1} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (1985a248-6fda-4bd8-b1ca-0f6992d154ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268f64d2-8215-4006-9505-77cea1581340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268f64d2-8215-4006-9505-77cea1581340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-629964220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:49Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2f0e57-3b40-4c5d-ac0e-ff81f24b0db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2f0e57-3b40-4c5d-ac0e-ff81f24b0db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63286eab-8948-446b-bed4-56c1f3c6664c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63286eab-8948-446b-bed4-56c1f3c6664c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c', 'volume_name': 'volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea4771c-8b7b-4ab0-9f20-b6f1a42925ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea4771c-8b7b-4ab0-9f20-b6f1a42925ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc894ab1-25f4-4642-9261-82a417908061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume 00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c', 'volume_size': 1} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:49 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00 1073741824" returned: 0 in 0.791s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:49 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00 Apr 29 10:40:49 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (eb0ad23d-3e72-4c3d-addd-b821c73200a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a9c72b-b2d2-4a3b-adac-6e29b41436c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a9c72b-b2d2-4a3b-adac-6e29b41436c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1209153018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a58362-bad8-4b4b-a0c9-120a0e574b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:50Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96220565-0415-4cbd-995f-363a53510348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96220565-0415-4cbd-995f-363a53510348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b965f01-f857-473c-af95-4b33e47b32dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b965f01-f857-473c-af95-4b33e47b32dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a58362-bad8-4b4b-a0c9-120a0e574b40', 'volume_name': 'volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9353115a-f74c-4848-a1d1-8862610577df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9353115a-f74c-4848-a1d1-8862610577df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dfcad5-5c91-4498-bfa0-26fcbd314141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:49 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume a3a58362-bad8-4b4b-a0c9-120a0e574b40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40', 'volume_size': 1} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:40:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (98ef1487-91fe-4555-98dc-4984cd5bbba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da9c6d1-e9ec-4d70-932c-e5cf86595a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da9c6d1-e9ec-4d70-932c-e5cf86595a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1034086895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9400da2-d2e9-402b-a8d6-023a898afe30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:50Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e43b69-e107-457a-8e99-d0d8a55719b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e43b69-e107-457a-8e99-d0d8a55719b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f70d4aa-6666-410e-8471-d7aa6a3a813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f70d4aa-6666-410e-8471-d7aa6a3a813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9400da2-d2e9-402b-a8d6-023a898afe30', 'volume_name': 'volume-b9400da2-d2e9-402b-a8d6-023a898afe30', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a672e817-6da6-4aad-8943-b058208b6803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a672e817-6da6-4aad-8943-b058208b6803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd83f83f-52d4-44ec-a4b8-2c27a5f992ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:50 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume b9400da2-d2e9-402b-a8d6-023a898afe30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9400da2-d2e9-402b-a8d6-023a898afe30', 'volume_size': 1} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:50 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00" returned: 0 in 0.611s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.129s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2129597621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d8393b-da9c-4b55-b444-77d8c2c934ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:49Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Creating volume 39d8393b-da9c-4b55-b444-77d8c2c934ac {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:40:50 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040eec6c-bea8-4483-9438-504fbb2a2925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc3c28c-4ae4-4872-ba54-170418a58c00', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f82c39-8785-447c-81df-fa006c2e837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:50 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac 1073741824 Apr 29 10:40:50 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:50 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume volume-9cc3c28c-4ae4-4872-ba54-170418a58c00 (9cc3c28c-4ae4-4872-ba54-170418a58c00): created successfully Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f82c39-8785-447c-81df-fa006c2e837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (411888d7-131a-485a-8545-3ce5c6685b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:50 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9e752de4-88f3-4bd6-8856-8a25ad3787b0 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created volume successfully. Apr 29 10:40:50 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac 1073741824" returned: 0 in 0.761s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:50 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac Apr 29 10:40:50 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:51 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac" returned: 0 in 0.564s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.166s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-629964220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:49Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Creating volume 00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:40:51 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:51 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c 1073741824 Apr 29 10:40:51 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76fa61b-326e-4c1c-a35e-c9dfbc3120c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d8393b-da9c-4b55-b444-77d8c2c934ac', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8759e85-b6d8-48ed-b75c-844ae522f18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:51 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume volume-39d8393b-da9c-4b55-b444-77d8c2c934ac (39d8393b-da9c-4b55-b444-77d8c2c934ac): created successfully Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8759e85-b6d8-48ed-b75c-844ae522f18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (6c833d99-ce25-402e-bb44-1f58350af919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-a9ef42bc-782c-4f0d-b870-9360bc652638 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created volume successfully. Apr 29 10:40:52 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c 1073741824" returned: 0 in 0.740s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:52 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c Apr 29 10:40:52 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:52 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c" returned: 0 in 0.563s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.104s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1209153018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a58362-bad8-4b4b-a0c9-120a0e574b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:50Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Creating volume a3a58362-bad8-4b4b-a0c9-120a0e574b40 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:40:52 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:52 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40 1073741824 Apr 29 10:40:52 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc894ab1-25f4-4642-9261-82a417908061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed98dfd8-229a-4e83-bc53-139a3a1d4a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:52 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c (00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c): created successfully Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed98dfd8-229a-4e83-bc53-139a3a1d4a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (1985a248-6fda-4bd8-b1ca-0f6992d154ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:52 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f032d695-ccfd-46ec-b977-147d0397d863 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created volume successfully. Apr 29 10:40:53 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40 1073741824" returned: 0 in 0.712s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:53 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40 Apr 29 10:40:53 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:54 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40" returned: 0 in 0.570s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.124s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1034086895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9400da2-d2e9-402b-a8d6-023a898afe30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfceb85ec8c48e880479e8ea7637a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:40:50Z,use_quota=True,user_id='0b857f557d444671af9065717f7159d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Creating volume b9400da2-d2e9-402b-a8d6-023a898afe30 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:40:54 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dfcad5-5c91-4498-bfa0-26fcbd314141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:54 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30 1073741824 Apr 29 10:40:54 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d59bae-4c53-4cb7-b29c-a5af62a5f151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:54 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40 (a3a58362-bad8-4b4b-a0c9-120a0e574b40): created successfully Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8d59bae-4c53-4cb7-b29c-a5af62a5f151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (eb0ad23d-3e72-4c3d-addd-b821c73200a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:54 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-558d8826-50ad-4d07-9873-2269faa26113 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created volume successfully. Apr 29 10:40:54 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30 1073741824" returned: 0 in 0.716s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:54 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30 Apr 29 10:40:54 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:55 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30" returned: 0 in 0.567s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:40:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd83f83f-52d4-44ec-a4b8-2c27a5f992ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9400da2-d2e9-402b-a8d6-023a898afe30', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c85360-f065-4248-b2fb-1e88d6107bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:40:55 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Volume volume-b9400da2-d2e9-402b-a8d6-023a898afe30 (b9400da2-d2e9-402b-a8d6-023a898afe30): created successfully Apr 29 10:40:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c85360-f065-4248-b2fb-1e88d6107bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:40:55 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Flow 'volume_create_manager' (98ef1487-91fe-4555-98dc-4984cd5bbba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:40:55 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-77b8a655-4cfa-4285-b176-e46674c389f7 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created volume successfully. Apr 29 10:40:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-b9400da2-d2e9-402b-a8d6-023a898afe30-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-b9400da2-d2e9-402b-a8d6-023a898afe30-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-quobyte-b9400da2-d2e9-402b-a8d6-023a898afe30" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-b9400da2-d2e9-402b-a8d6-023a898afe30" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:56 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8beeb9-c513-4d65-aa89-a259919c23da]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:56 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30 Apr 29 10:40:56 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:57 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30" returned: 0 in 0.675s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:57 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30 Apr 29 10:40:57 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:57 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-b9400da2-d2e9-402b-a8d6-023a898afe30" returned: 0 in 0.569s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-b9400da2-d2e9-402b-a8d6-023a898afe30" released by "delete_volume" :: held 1.282s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Created reservations ['124a4eda-b008-4dba-806d-5bde96221647', '4998e890-6362-41ac-893e-b271d1ba47ed', '8da0a36c-2ae8-45b4-bb4d-a71897acc45f', '5d4f89d2-301d-4593-a84f-fe2bb5026c45'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:40:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:58 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:40:58 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:58 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.551s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:58 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:40:58 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Deleted volume successfully. Apr 29 10:40:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4a665968-12f6-4771-b77a-c7325a96a32a tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-b9400da2-d2e9-402b-a8d6-023a898afe30-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:40:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-a3a58362-bad8-4b4b-a0c9-120a0e574b40-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-a3a58362-bad8-4b4b-a0c9-120a0e574b40-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-quobyte-a3a58362-bad8-4b4b-a0c9-120a0e574b40" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:40:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-a3a58362-bad8-4b4b-a0c9-120a0e574b40" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:40:58 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af8da70-7848-495b-981d-bdb5e12c7b41]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:40:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:58 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40 Apr 29 10:40:58 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:40:59 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Apr 29 10:40:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40" returned: 0 in 0.663s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:40:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:40:59 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40 Apr 29 10:40:59 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:00 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-a3a58362-bad8-4b4b-a0c9-120a0e574b40" returned: 0 in 0.565s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-a3a58362-bad8-4b4b-a0c9-120a0e574b40" released by "delete_volume" :: held 1.263s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Created reservations ['0774acda-60b2-4910-aa93-c438a583a80d', '06327514-b8d8-45c0-83e5-db7f7ac4d1ef', '34c860ef-753f-44df-8ac4-e1e60f33462d', '201db653-0b11-405e-a38a-8ea16b023c63'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:00 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:00 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:00 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.577s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:00 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Deleted volume successfully. Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a3e30fc7-8205-44fa-b946-4c4ee065ca8d tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-a3a58362-bad8-4b4b-a0c9-120a0e574b40-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-quobyte-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c" acquired by "delete_volume" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:01 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f5d8d9-c3dd-4dc1-9090-407b828a5512]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:01 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c Apr 29 10:41:01 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:01 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c" returned: 0 in 0.663s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:01 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c Apr 29 10:41:01 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:02 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c" returned: 0 in 0.602s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c" released by "delete_volume" :: held 1.303s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created reservations ['8ee8c6c7-bbd1-46ff-a7b7-d4b1a1b634f7', '4673ae06-a13f-430e-a2a5-d319868cf7e0', '4eb36f4d-0d71-44b2-b786-51806ffc5517', '3631b141-8b84-4971-b62d-0504e26a6cd5'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:02 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:02 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:02 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.565s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:02 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:02 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Deleted volume successfully. Apr 29 10:41:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-b345a24a-0e7b-4665-82d9-950a061ead62 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-00cf86f6-8e8a-4b0e-9dd0-82ed9b935d7c-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-39d8393b-da9c-4b55-b444-77d8c2c934ac-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-39d8393b-da9c-4b55-b444-77d8c2c934ac-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-quobyte-39d8393b-da9c-4b55-b444-77d8c2c934ac" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-39d8393b-da9c-4b55-b444-77d8c2c934ac" acquired by "delete_volume" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:03 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1628f9-9a49-4fbf-9114-9e4df24809b7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:03 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac Apr 29 10:41:03 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:03 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac" returned: 0 in 0.660s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:03 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac Apr 29 10:41:03 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:04 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-39d8393b-da9c-4b55-b444-77d8c2c934ac" returned: 0 in 0.567s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-39d8393b-da9c-4b55-b444-77d8c2c934ac" released by "delete_volume" :: held 1.263s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:04 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created reservations ['1bea180c-388f-4601-837d-90f3cc68f1c0', '26abfb14-7ba7-41a9-8d8c-88e974f67c85', '972b70d8-e181-42e0-b58a-7d5df5ad7d03', '508381c9-26fc-441e-8b09-43ca3e580709'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:04 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:04 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:05 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.558s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:05 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Deleted volume successfully. Apr 29 10:41:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-0235225c-6abb-4a1b-ae2e-fbbc79551888 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-39d8393b-da9c-4b55-b444-77d8c2c934ac-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-9cc3c28c-4ae4-4872-ba54-170418a58c00-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-9cc3c28c-4ae4-4872-ba54-170418a58c00-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-quobyte-9cc3c28c-4ae4-4872-ba54-170418a58c00" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-9cc3c28c-4ae4-4872-ba54-170418a58c00" acquired by "delete_volume" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:05 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dfeaf2-536a-4412-9996-36118c210139]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:05 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00 Apr 29 10:41:05 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:06 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00" returned: 0 in 0.676s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:06 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00 Apr 29 10:41:06 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:06 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9cc3c28c-4ae4-4872-ba54-170418a58c00" returned: 0 in 0.565s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-9cc3c28c-4ae4-4872-ba54-170418a58c00" released by "delete_volume" :: held 1.278s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created reservations ['44ec97b9-6e0a-47bd-a2f8-bf51f32608f7', '15715639-2536-4aaa-b56a-b3785e00fccf', '1890fa5c-3f84-4ba7-ab06-0048b7801fbd', 'de5793e1-a631-40f8-bcf7-4493f508c2ef'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:06 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:06 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:07 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.562s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:07 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Deleted volume successfully. Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-c0983650-b8e9-4459-88bc-254ffc0d6423 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-9cc3c28c-4ae4-4872-ba54-170418a58c00-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-1dfd302a-fb82-4290-b494-14020d0fbfe3-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-1dfd302a-fb82-4290-b494-14020d0fbfe3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-quobyte-7fc76ecd-9973-47ba-9018-294f3c24b215" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-7fc76ecd-9973-47ba-9018-294f3c24b215" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-quobyte-1dfd302a-fb82-4290-b494-14020d0fbfe3" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-1dfd302a-fb82-4290-b494-14020d0fbfe3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Deleting offline snapshot 1dfd302a-fb82-4290-b494-14020d0fbfe3 of volume 7fc76ecd-9973-47ba-9018-294f3c24b215 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] snapshot_file for this snap is: volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a95093-1763-47bc-a434-00366ff5ccb6]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:07 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 Apr 29 10:41:07 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:08 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3" returned: 0 in 0.661s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fc76ecd-9973-47ba-9018-294f3c24b215(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:41:08 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[31de5f90-3e3d-4363-ab9b-fbacddd8fe5a]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:08 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 Apr 29 10:41:08 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:09 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215" returned: 0 in 0.654s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:09 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 Apr 29 10:41:09 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:09 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3" returned: 0 in 0.630s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:09 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3 Apr 29 10:41:09 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:10 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215.1dfd302a-fb82-4290-b494-14020d0fbfe3" returned: 0 in 0.556s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-1dfd302a-fb82-4290-b494-14020d0fbfe3" released by "_delete_snapshot" :: held 2.588s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-7fc76ecd-9973-47ba-9018-294f3c24b215" released by "delete_snapshot" :: held 2.607s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created reservations ['4ffc093f-0ed8-4440-a09d-3f477d767a56', '91e8f8bd-62fe-421a-a7da-471cc06882d7', '6656ab31-1209-4537-84fe-e25ccb3ddf37', 'f72b2013-1ed7-475d-a64f-d74bf4f73b24'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:10 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Delete snapshot completed successfully. Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6cec13c0-b132-4adc-8571-e299471d1e12 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-1dfd302a-fb82-4290-b494-14020d0fbfe3-delete_snapshot" released by "delete_snapshot" :: held 2.720s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-7fc76ecd-9973-47ba-9018-294f3c24b215-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-7fc76ecd-9973-47ba-9018-294f3c24b215-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "cinder-quobyte-7fc76ecd-9973-47ba-9018-294f3c24b215" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-7fc76ecd-9973-47ba-9018-294f3c24b215" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4114f830-36de-4c74-bfcd-5c4a915c7755]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:10 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 Apr 29 10:41:10 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:11 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215" returned: 0 in 0.665s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:11 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215 Apr 29 10:41:11 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:12 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7fc76ecd-9973-47ba-9018-294f3c24b215" returned: 0 in 0.564s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-quobyte-7fc76ecd-9973-47ba-9018-294f3c24b215" released by "delete_volume" :: held 1.279s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Created reservations ['f7ddea4b-ce29-476a-943c-daaa2b463a35', 'd8d9361b-5ba2-4662-becb-7b63cf02236f', '2f3ce3ae-3ded-418b-bca2-7f0f57c1caed', '4030cac8-7a09-43cc-8785-e0958bc934a4'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:12 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:12 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:12 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.568s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:12 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Deleted volume successfully. Apr 29 10:41:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-899e2e10-7a9e-43c1-ada1-fe975da26507 tempest-CreateVolumesFromSnapshotTest-180180585 None] Lock "cinder-7fc76ecd-9973-47ba-9018-294f3c24b215-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=119,cinder:INSERT=49,cinder:UPDATE=163,cinder:DELETE=13 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (9b734357-0085-4c57-9db6-663268a4abba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a564b68e-27b7-490c-97e8-301ccdbdd479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a564b68e-27b7-490c-97e8-301ccdbdd479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-739397645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a29ec7d-e243-49cc-b37f-66470e0ed00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:15Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7535457-f679-4cb7-9e3e-d857597fb400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7535457-f679-4cb7-9e3e-d857597fb400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15412bac-8adc-4391-a249-2210c74841f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15412bac-8adc-4391-a249-2210c74841f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a29ec7d-e243-49cc-b37f-66470e0ed00f', 'volume_name': 'volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6856a621-ff3f-4189-a65e-2c25895f8560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6856a621-ff3f-4189-a65e-2c25895f8560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a239b7c8-0b3e-4677-ab8b-b6b5e52225d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:15 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume 3a29ec7d-e243-49cc-b37f-66470e0ed00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f', 'volume_size': 1} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-739397645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a29ec7d-e243-49cc-b37f-66470e0ed00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:15Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Creating volume 3a29ec7d-e243-49cc-b37f-66470e0ed00f {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:15 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:15 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f 1073741824 Apr 29 10:41:15 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:16 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f 1073741824" returned: 0 in 0.716s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:16 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=118,cinder:INSERT=33,cinder:UPDATE=167,cinder:DELETE=14 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:41:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:16 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f Apr 29 10:41:16 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:16 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f" returned: 0 in 0.561s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a239b7c8-0b3e-4677-ab8b-b6b5e52225d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c7eef8-2dde-4cc6-b69a-752825bbb934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:16 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f (3a29ec7d-e243-49cc-b37f-66470e0ed00f): created successfully Apr 29 10:41:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c7eef8-2dde-4cc6-b69a-752825bbb934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:16 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (9b734357-0085-4c57-9db6-663268a4abba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:16 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-dd19bf70-873e-4ecd-8843-94842452fbbc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created volume successfully. Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (ace7061f-abf5-4fff-9fb8-6b223432f9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc4fe8d-7434-4f7d-a4b2-bfa03025793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc4fe8d-7434-4f7d-a4b2-bfa03025793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257489219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3c193d-d82f-4834-b9d4-0cf7c897fa5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:18Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986c39f6-6446-4de4-83ff-6faddacc6d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986c39f6-6446-4de4-83ff-6faddacc6d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa41a73-ee05-423f-be47-5ea6931c98a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa41a73-ee05-423f-be47-5ea6931c98a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3c193d-d82f-4834-b9d4-0cf7c897fa5c', 'volume_name': 'volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15927187-d477-40b1-a5b9-d9ddd00bfc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15927187-d477-40b1-a5b9-d9ddd00bfc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281865ff-2f69-44fd-9f1b-703551476540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:17 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume 6b3c193d-d82f-4834-b9d4-0cf7c897fa5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c', 'volume_size': 1} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257489219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3c193d-d82f-4834-b9d4-0cf7c897fa5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:18Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Creating volume 6b3c193d-d82f-4834-b9d4-0cf7c897fa5c {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:17 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:17 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c 1073741824 Apr 29 10:41:17 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (ceb2a6d6-4c7d-4476-ab39-cf63be199e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c28a88d-d406-49a4-b653-85d3e0465f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c28a88d-d406-49a4-b653-85d3e0465f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1025496136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:18Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4605c4b6-1b18-4f24-8944-e12b0b191410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4605c4b6-1b18-4f24-8944-e12b0b191410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf7f524-bf0d-442a-899a-40e7318dc9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf7f524-bf0d-442a-899a-40e7318dc9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e', 'volume_name': 'volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a824a3-37a3-4126-87c7-4694bc8d353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a824a3-37a3-4126-87c7-4694bc8d353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8039a619-8f54-4cf2-abe1-2b5754a76166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume 9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e', 'volume_size': 1} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (f9798373-bcdb-4dd1-a700-f28fa30e0e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de49907e-de9b-4c17-ae66-79252d5d1a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de49907e-de9b-4c17-ae66-79252d5d1a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574447781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3224a6d2-3e5c-455d-95f9-deb121aac10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:18Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43189ef6-3136-49e0-acca-d72a99827792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43189ef6-3136-49e0-acca-d72a99827792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d318371-3721-4bc3-aced-39ce7bed6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d318371-3721-4bc3-aced-39ce7bed6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3224a6d2-3e5c-455d-95f9-deb121aac10d', 'volume_name': 'volume-3224a6d2-3e5c-455d-95f9-deb121aac10d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202f1ce7-96b7-4e49-9d57-e14e9ab474e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202f1ce7-96b7-4e49-9d57-e14e9ab474e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b207f0-8b47-4034-8dfa-dfeba8151725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume 3224a6d2-3e5c-455d-95f9-deb121aac10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3224a6d2-3e5c-455d-95f9-deb121aac10d', 'volume_size': 1} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:18 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c 1073741824" returned: 0 in 0.839s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:18 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c Apr 29 10:41:18 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (7b70dae9-dae0-4adf-9492-82528ae7a9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681b8f72-2f36-4c32-9b31-36025916d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681b8f72-2f36-4c32-9b31-36025916d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2069993801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620ed114-a32f-44af-b08d-49cb48cfc567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:19Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2085f4-0b46-4a94-9917-1afa834d25d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2085f4-0b46-4a94-9917-1afa834d25d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aad4bc-7364-49c3-a8c2-9006d55e7665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aad4bc-7364-49c3-a8c2-9006d55e7665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620ed114-a32f-44af-b08d-49cb48cfc567', 'volume_name': 'volume-620ed114-a32f-44af-b08d-49cb48cfc567', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9da0ff1-7a1c-450a-8095-4859dbb1a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9da0ff1-7a1c-450a-8095-4859dbb1a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f3be23-b51e-4006-950e-a79f0c69bf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:18 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume 620ed114-a32f-44af-b08d-49cb48cfc567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620ed114-a32f-44af-b08d-49cb48cfc567', 'volume_size': 1} Apr 29 10:41:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (e4113245-decb-49ae-957e-cf3aa6f394f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52061ed9-6291-4cec-92a2-362dafe3e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52061ed9-6291-4cec-92a2-362dafe3e174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1280852065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3bb116-4754-4d5c-a16c-7d6b42f785b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:19Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e89da9-59b9-4c4c-bc97-0c805379701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e89da9-59b9-4c4c-bc97-0c805379701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54938e06-e57d-4890-a1db-448d4d23ce29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54938e06-e57d-4890-a1db-448d4d23ce29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3bb116-4754-4d5c-a16c-7d6b42f785b9', 'volume_name': 'volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fae512-434f-4a21-bf52-1afaef40a81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fae512-434f-4a21-bf52-1afaef40a81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a820568e-6e00-4ded-8cb0-72396437f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:19 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume ac3bb116-4754-4d5c-a16c-7d6b42f785b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9', 'volume_size': 1} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:19 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c" returned: 0 in 0.591s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.144s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1025496136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:18Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Creating volume 9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:19 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281865ff-2f69-44fd-9f1b-703551476540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:19 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e 1073741824 Apr 29 10:41:19 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e8ed12-dd56-4e6f-bb42-885bef2991b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:19 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c (6b3c193d-d82f-4834-b9d4-0cf7c897fa5c): created successfully Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e8ed12-dd56-4e6f-bb42-885bef2991b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (ace7061f-abf5-4fff-9fb8-6b223432f9a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4e8e65bd-0d37-4fcf-99a3-66ec26f9c151 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created volume successfully. Apr 29 10:41:20 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e 1073741824" returned: 0 in 0.725s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:20 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e Apr 29 10:41:20 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:20 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e" returned: 0 in 0.569s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.080s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574447781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3224a6d2-3e5c-455d-95f9-deb121aac10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:18Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Creating volume 3224a6d2-3e5c-455d-95f9-deb121aac10d {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:20 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8039a619-8f54-4cf2-abe1-2b5754a76166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:20 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d 1073741824 Apr 29 10:41:20 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d9fe11-5f60-4ec4-b26d-009de150f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:20 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e (9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e): created successfully Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d9fe11-5f60-4ec4-b26d-009de150f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (ceb2a6d6-4c7d-4476-ab39-cf63be199e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:20 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-c0fe16ad-6d3f-400b-8525-cac3e5f338b4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created volume successfully. Apr 29 10:41:21 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d 1073741824" returned: 0 in 0.744s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:21 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d Apr 29 10:41:21 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:22 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d" returned: 0 in 0.551s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.124s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2069993801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620ed114-a32f-44af-b08d-49cb48cfc567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:19Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Creating volume 620ed114-a32f-44af-b08d-49cb48cfc567 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:22 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:22 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567 1073741824 Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b207f0-8b47-4034-8dfa-dfeba8151725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3224a6d2-3e5c-455d-95f9-deb121aac10d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:22 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2476d5-b5ab-41b8-89a9-3930b46e918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:22 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume volume-3224a6d2-3e5c-455d-95f9-deb121aac10d (3224a6d2-3e5c-455d-95f9-deb121aac10d): created successfully Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2476d5-b5ab-41b8-89a9-3930b46e918b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (f9798373-bcdb-4dd1-a700-f28fa30e0e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:22 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-81d6d67c-37eb-42da-a7e3-aca2905cdec9 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created volume successfully. Apr 29 10:41:22 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567 1073741824" returned: 0 in 0.742s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:22 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567 Apr 29 10:41:22 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:23 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567" returned: 0 in 0.564s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.175s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1280852065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3bb116-4754-4d5c-a16c-7d6b42f785b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed60ab939824a54b189e75c626d59c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:19Z,use_quota=True,user_id='35b70a497456489b81b487c1b22f8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Creating volume ac3bb116-4754-4d5c-a16c-7d6b42f785b9 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:23 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f3be23-b51e-4006-950e-a79f0c69bf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620ed114-a32f-44af-b08d-49cb48cfc567', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:23 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9 1073741824 Apr 29 10:41:23 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ba6b62-945e-4f6c-a6c8-2c86dd01c6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:23 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume volume-620ed114-a32f-44af-b08d-49cb48cfc567 (620ed114-a32f-44af-b08d-49cb48cfc567): created successfully Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ba6b62-945e-4f6c-a6c8-2c86dd01c6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (7b70dae9-dae0-4adf-9492-82528ae7a9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e004a317-dc15-4937-a6dc-ef12699861e4 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created volume successfully. Apr 29 10:41:24 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9 1073741824" returned: 0 in 0.726s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:24 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9 Apr 29 10:41:24 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:24 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9" returned: 0 in 0.559s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a820568e-6e00-4ded-8cb0-72396437f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d66a52-c0e2-401d-949b-f2c33f2f0114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:24 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Volume volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9 (ac3bb116-4754-4d5c-a16c-7d6b42f785b9): created successfully Apr 29 10:41:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d66a52-c0e2-401d-949b-f2c33f2f0114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Flow 'volume_create_manager' (e4113245-decb-49ae-957e-cf3aa6f394f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:24 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-3e26447f-9d58-4fc3-9b5e-d48a8e2e8bbd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created volume successfully. Apr 29 10:41:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-ac3bb116-4754-4d5c-a16c-7d6b42f785b9-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-ac3bb116-4754-4d5c-a16c-7d6b42f785b9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-quobyte-ac3bb116-4754-4d5c-a16c-7d6b42f785b9" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-ac3bb116-4754-4d5c-a16c-7d6b42f785b9" acquired by "delete_volume" :: waited 0.013s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:25 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a7bd8e-8e40-46b7-918c-3556992142ec]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:25 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9 Apr 29 10:41:25 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:26 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9" returned: 0 in 0.671s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:26 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9 Apr 29 10:41:26 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:26 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ac3bb116-4754-4d5c-a16c-7d6b42f785b9" returned: 0 in 0.555s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-ac3bb116-4754-4d5c-a16c-7d6b42f785b9" released by "delete_volume" :: held 1.260s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created reservations ['5d752a28-8100-41c2-bf5b-43388615ca52', 'bb11a179-eb11-4bd9-95ca-0a8953552b76', '0611275b-3f7d-410a-8da3-37d0a839942f', '180b691f-7479-4213-8c3f-ad91e0eb2c43'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:27 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:27 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:27 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.564s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:27 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Deleted volume successfully. Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-60faf514-aa5e-472a-b91c-655e9702f98f tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-ac3bb116-4754-4d5c-a16c-7d6b42f785b9-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-620ed114-a32f-44af-b08d-49cb48cfc567-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-620ed114-a32f-44af-b08d-49cb48cfc567-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-quobyte-620ed114-a32f-44af-b08d-49cb48cfc567" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-620ed114-a32f-44af-b08d-49cb48cfc567" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a198fdbd-4884-4f16-910e-5433b9d8d075]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:28 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567 Apr 29 10:41:28 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:28 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567" returned: 0 in 0.661s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:28 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567 Apr 29 10:41:28 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:29 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-620ed114-a32f-44af-b08d-49cb48cfc567" returned: 0 in 0.564s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-620ed114-a32f-44af-b08d-49cb48cfc567" released by "delete_volume" :: held 1.260s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created reservations ['1cd26437-606c-4a1a-a30f-fb779f57576f', '4c870d89-e030-4052-af8d-171f98244833', '7ca93164-1e5c-4599-a26d-404174e1a5b0', '0a16f170-4d7c-4e5e-b207-61e85120cc48'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:29 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:29 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:29 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.553s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:29 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Deleted volume successfully. Apr 29 10:41:29 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-4e31f3ef-0178-49fe-a739-bd6e28dc5cc0 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-620ed114-a32f-44af-b08d-49cb48cfc567-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-3224a6d2-3e5c-455d-95f9-deb121aac10d-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-3224a6d2-3e5c-455d-95f9-deb121aac10d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-quobyte-3224a6d2-3e5c-455d-95f9-deb121aac10d" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-3224a6d2-3e5c-455d-95f9-deb121aac10d" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:30 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b0a830-9a07-4758-9b9a-705116057262]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:30 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d Apr 29 10:41:30 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:30 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d" returned: 0 in 0.668s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:30 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d Apr 29 10:41:30 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:31 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3224a6d2-3e5c-455d-95f9-deb121aac10d" returned: 0 in 0.561s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-3224a6d2-3e5c-455d-95f9-deb121aac10d" released by "delete_volume" :: held 1.263s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:31 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created reservations ['fc098a09-385e-4448-86fd-3a57587773c4', '18f4937a-467f-4297-a8bd-3d8600084d03', 'ef342e59-9745-4bc4-979c-5519a2e94c6c', '9ede19e4-9dee-4c5e-9b2b-d9a4e6159e7c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:31 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:31 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:32 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.560s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:32 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:32 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Deleted volume successfully. Apr 29 10:41:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-93c5b6e4-d3db-48f6-a779-e494c642061e tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-3224a6d2-3e5c-455d-95f9-deb121aac10d-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-quobyte-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e" acquired by "delete_volume" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:32 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f81dbe8-b4a3-4360-8537-cc90ea0be976]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:32 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e Apr 29 10:41:32 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:33 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e" returned: 0 in 0.673s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:33 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e Apr 29 10:41:33 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:33 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:33 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:33 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e" returned: 0 in 0.575s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e" released by "delete_volume" :: held 1.287s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created reservations ['8ba1a070-7975-4bc0-9593-df58ac2c3e90', '4cfbc405-edfd-4466-8828-518d9292ab1b', 'd48fe26d-1836-413b-8ac6-278ec571e3c1', '6e0f9f23-1144-4103-bdaf-f03fb944858c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:33 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.603s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:33 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:33 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:34 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.574s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:34 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:34 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Deleted volume successfully. Apr 29 10:41:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2659b83e-8869-422c-a0e3-8d154ded11a1 tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-9edb3514-5af1-4f7f-af38-8a9fb6d5bc7e-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-quobyte-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c" acquired by "delete_volume" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:34 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab7524e-af85-4fee-8b56-f24e71ea77cc]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:34 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c Apr 29 10:41:34 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:35 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c" returned: 0 in 0.703s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:35 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c Apr 29 10:41:35 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:35 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c" returned: 0 in 0.564s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c" released by "delete_volume" :: held 1.305s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created reservations ['5763897d-fba8-4a1d-a370-087022c8fbf0', '65d4cedf-e00e-41d7-a26e-c6b6ef16b2ae', '90c697ad-273f-415c-9144-0ccb40d3d413', '8519ccd0-21ee-4fe8-bdf0-7259c239eca4'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:35 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:35 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:36 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.559s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:36 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:36 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Deleted volume successfully. Apr 29 10:41:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-27aaede7-e174-4c7b-b033-c1decbd27bcd tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-6b3c193d-d82f-4834-b9d4-0cf7c897fa5c-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-3a29ec7d-e243-49cc-b37f-66470e0ed00f-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-3a29ec7d-e243-49cc-b37f-66470e0ed00f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "cinder-quobyte-3a29ec7d-e243-49cc-b37f-66470e0ed00f" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:41:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-3a29ec7d-e243-49cc-b37f-66470e0ed00f" acquired by "delete_volume" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:41:36 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f84647-d9dd-422d-801c-0afc69bf277e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:41:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:36 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f Apr 29 10:41:36 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:37 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f" returned: 0 in 0.667s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:37 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f Apr 29 10:41:37 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:38 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3a29ec7d-e243-49cc-b37f-66470e0ed00f" returned: 0 in 0.592s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-quobyte-3a29ec7d-e243-49cc-b37f-66470e0ed00f" released by "delete_volume" :: held 1.298s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Created reservations ['8437a08d-4839-43be-babe-2a87e3523348', 'fc7b3ff5-3387-4fb3-8cb2-888d577bc7c4', '5bb4c6bc-e04f-41e0-a77a-156d89090f3f', '1a3d32fe-f1b5-4625-bd05-03bd614ef3b4'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:38 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:41:38 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:38 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.570s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:41:38 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Deleted volume successfully. Apr 29 10:41:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-52fb54a2-2349-4956-a03c-867262d3e5dc tempest-CreateVolumesFromSourceVolumeTest-1265714102 None] Lock "cinder-3a29ec7d-e243-49cc-b37f-66470e0ed00f-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:41:48 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=64,cinder:SELECT=45,cinder:INSERT=17,cinder:DELETE=4 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:41:48 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=67,cinder:SELECT=36,cinder:INSERT=13,cinder:DELETE=8 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Flow 'volume_create_manager' (3765f820-ab33-4228-84a2-fd8b33dc69cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd5ab48-6000-4550-a714-b4746ff81940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd5ab48-6000-4550-a714-b4746ff81940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1015167599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc227b64-f741-49b3-b056-a9843dfd7a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062586f371bb4936a1d52cc972ef3809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:49Z,use_quota=True,user_id='4f8193ab8eb84ed695afee7c6d33c629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5edf2394-5717-42ca-a6ee-d18c1257973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5edf2394-5717-42ca-a6ee-d18c1257973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d1d878-0c2b-4663-a74a-589ad81ce094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d1d878-0c2b-4663-a74a-589ad81ce094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc227b64-f741-49b3-b056-a9843dfd7a2b', 'volume_name': 'volume-bc227b64-f741-49b3-b056-a9843dfd7a2b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ca1779-5942-45c1-ada0-3d9c389e61ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ca1779-5942-45c1-ada0-3d9c389e61ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6a911b-6e13-415d-82a8-72c0ad820135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:49 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Volume bc227b64-f741-49b3-b056-a9843dfd7a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc227b64-f741-49b3-b056-a9843dfd7a2b', 'volume_size': 1} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1015167599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc227b64-f741-49b3-b056-a9843dfd7a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062586f371bb4936a1d52cc972ef3809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:49Z,use_quota=True,user_id='4f8193ab8eb84ed695afee7c6d33c629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Creating volume bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:49 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:49 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b 1073741824 Apr 29 10:41:49 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (df3db281-c35e-4124-a938-69669acaf0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835468ed-f070-4958-9afe-8376f48f577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835468ed-f070-4958-9afe-8376f48f577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1647672481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ee0b5e-37ca-4772-89fd-1ff97be2639d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:50Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc7b52c-8636-47cd-a70c-d7bca78782d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc7b52c-8636-47cd-a70c-d7bca78782d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac1899c-e64a-4def-a2b9-430a4b7aa898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac1899c-e64a-4def-a2b9-430a4b7aa898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ee0b5e-37ca-4772-89fd-1ff97be2639d', 'volume_name': 'volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfbd12f-c5cf-4cca-b43f-27032fed4baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfbd12f-c5cf-4cca-b43f-27032fed4baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c01311-d05d-44e7-8005-c6751542fe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:49 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume 55ee0b5e-37ca-4772-89fd-1ff97be2639d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d', 'volume_size': 1} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:49 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Flow 'volume_create_manager' (4af73990-fb7f-4bb2-adb3-5c841db5c002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20223189-0043-471e-9b96-cdcb057baeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20223189-0043-471e-9b96-cdcb057baeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-705240830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f8062d-e7be-4ec8-8f10-06a0babcaf46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bce460fc2b4a82bd3d01f3b0a9992d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:50Z,use_quota=True,user_id='58dce4f62b374ac2a6e270daca9f9cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230e68f1-d19e-4505-b452-021a01796435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230e68f1-d19e-4505-b452-021a01796435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66144a1-c710-4fa4-bc80-40b1ba2578ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66144a1-c710-4fa4-bc80-40b1ba2578ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f8062d-e7be-4ec8-8f10-06a0babcaf46', 'volume_name': 'volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a664ef68-c94f-4c16-bf90-ec3c76140137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a664ef68-c94f-4c16-bf90-ec3c76140137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c3cdfb-2f63-492a-a5db-62fade346e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Volume c3f8062d-e7be-4ec8-8f10-06a0babcaf46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46', 'volume_size': 1} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Flow 'volume_create_manager' (1067e304-8061-4547-a8ca-97dc66e6b00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771b1159-4c5b-4ec8-9aeb-3fd02068e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771b1159-4c5b-4ec8-9aeb-3fd02068e022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1483201943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95b0bf5-ab4e-4d27-9c47-9344d43a0dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bce460fc2b4a82bd3d01f3b0a9992d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:50Z,use_quota=True,user_id='58dce4f62b374ac2a6e270daca9f9cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef61e512-0307-433c-9411-3c944f331818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef61e512-0307-433c-9411-3c944f331818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc48e56-9cd9-476a-a58a-b6cd86e9ce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc48e56-9cd9-476a-a58a-b6cd86e9ce63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95b0bf5-ab4e-4d27-9c47-9344d43a0dea', 'volume_name': 'volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2748d91-efd6-4979-ace1-b313c245904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2748d91-efd6-4979-ace1-b313c245904b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c810363-8a97-47bb-a4e7-150e9ee13bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Volume c95b0bf5-ab4e-4d27-9c47-9344d43a0dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea', 'volume_size': 1} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:50 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b 1073741824" returned: 0 in 1.113s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:50 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b Apr 29 10:41:50 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Flow 'volume_create_manager' (2ef0f62f-b526-4022-a61d-2db328927b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87db393-04af-4dc3-aa3d-c6c180289a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87db393-04af-4dc3-aa3d-c6c180289a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-496554432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31018189-3b84-40f2-9ea1-a7f418e0925d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bce460fc2b4a82bd3d01f3b0a9992d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:51Z,use_quota=True,user_id='58dce4f62b374ac2a6e270daca9f9cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0923084-9c24-437f-bf81-486a05df2a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0923084-9c24-437f-bf81-486a05df2a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89634508-05d7-40d3-bffb-e80088a2bde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89634508-05d7-40d3-bffb-e80088a2bde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31018189-3b84-40f2-9ea1-a7f418e0925d', 'volume_name': 'volume-31018189-3b84-40f2-9ea1-a7f418e0925d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b659dc9b-a315-49f5-8068-9977c9d0d601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b659dc9b-a315-49f5-8068-9977c9d0d601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c65e19a-64f5-4c9c-b55e-3f82dbd58ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:50 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Volume 31018189-3b84-40f2-9ea1-a7f418e0925d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31018189-3b84-40f2-9ea1-a7f418e0925d', 'volume_size': 1} Apr 29 10:41:50 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Flow 'volume_create_manager' (063312d4-7e68-47af-9119-00e954d91a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd119563-004c-4863-9488-736a05a69885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd119563-004c-4863-9488-736a05a69885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1038862940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6eb400f-a51a-4413-8a30-e21e2df7885b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bce460fc2b4a82bd3d01f3b0a9992d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:51Z,use_quota=True,user_id='58dce4f62b374ac2a6e270daca9f9cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e2bff2-a3bb-4885-bbe9-caf5231a50d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e2bff2-a3bb-4885-bbe9-caf5231a50d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29eb264e-544c-416e-a5db-bee41df83e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29eb264e-544c-416e-a5db-bee41df83e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6eb400f-a51a-4413-8a30-e21e2df7885b', 'volume_name': 'volume-d6eb400f-a51a-4413-8a30-e21e2df7885b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5dde73-75cd-48e5-92f9-518541496a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5dde73-75cd-48e5-92f9-518541496a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509c8014-ca2c-40fe-a806-c290dc310145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Volume d6eb400f-a51a-4413-8a30-e21e2df7885b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6eb400f-a51a-4413-8a30-e21e2df7885b', 'volume_size': 1} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:51 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b" returned: 0 in 0.699s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.593s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1647672481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ee0b5e-37ca-4772-89fd-1ff97be2639d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:50Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Creating volume 55ee0b5e-37ca-4772-89fd-1ff97be2639d {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:51 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6a911b-6e13-415d-82a8-72c0ad820135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc227b64-f741-49b3-b056-a9843dfd7a2b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab869b03-1c1e-4c90-a513-49b06e3387aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Volume volume-bc227b64-f741-49b3-b056-a9843dfd7a2b (bc227b64-f741-49b3-b056-a9843dfd7a2b): created successfully Apr 29 10:41:51 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d 1073741824 Apr 29 10:41:51 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab869b03-1c1e-4c90-a513-49b06e3387aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Flow 'volume_create_manager' (3765f820-ab33-4228-84a2-fd8b33dc69cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:51 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e50becdb-d664-4ba3-aae7-cd630467313c tempest-VolumeDependencyTests-151890374 None] Created volume successfully. Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Flow 'volume_create_manager' (846fe3cd-b621-4878-a54f-258e2c95ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32fc214-db36-4120-b9c8-fc55ca23610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32fc214-db36-4120-b9c8-fc55ca23610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1319458447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d441cb14-c4a6-4f01-be0f-6a89b3f35bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bce460fc2b4a82bd3d01f3b0a9992d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:52Z,use_quota=True,user_id='58dce4f62b374ac2a6e270daca9f9cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3bdf72-2568-470c-8acd-ab14bd1eb1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3bdf72-2568-470c-8acd-ab14bd1eb1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d885676-4737-4189-8e37-cc9beab234e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d885676-4737-4189-8e37-cc9beab234e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd441cb14-c4a6-4f01-be0f-6a89b3f35bef', 'volume_name': 'volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668608d2-1dda-4f36-a89b-db6adaf75c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668608d2-1dda-4f36-a89b-db6adaf75c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a34285f-8e1b-4277-bfa6-f6ee7c7e35ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:51 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Volume d441cb14-c4a6-4f01-be0f-6a89b3f35bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef', 'volume_size': 1} Apr 29 10:41:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:52 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d 1073741824" returned: 0 in 1.070s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:52 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d Apr 29 10:41:52 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:53 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d" returned: 0 in 0.623s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.041s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-705240830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f8062d-e7be-4ec8-8f10-06a0babcaf46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bce460fc2b4a82bd3d01f3b0a9992d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:50Z,use_quota=True,user_id='58dce4f62b374ac2a6e270daca9f9cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Creating volume c3f8062d-e7be-4ec8-8f10-06a0babcaf46 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:53 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c01311-d05d-44e7-8005-c6751542fe07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:53 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46 1073741824 Apr 29 10:41:53 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ad8aed-3955-4c22-b608-dd79b81a5ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:53 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d (55ee0b5e-37ca-4772-89fd-1ff97be2639d): created successfully Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ad8aed-3955-4c22-b608-dd79b81a5ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (df3db281-c35e-4124-a938-69669acaf0e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:53 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-979c8dd1-dad7-4750-99d9-56b16ee2312d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created volume successfully. Apr 29 10:41:53 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46 1073741824" returned: 0 in 0.792s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:54 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46 Apr 29 10:41:54 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:54 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46" returned: 0 in 0.775s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.329s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1483201943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95b0bf5-ab4e-4d27-9c47-9344d43a0dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bce460fc2b4a82bd3d01f3b0a9992d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:50Z,use_quota=True,user_id='58dce4f62b374ac2a6e270daca9f9cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Creating volume c95b0bf5-ab4e-4d27-9c47-9344d43a0dea {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:54 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:54 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea 1073741824 Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c3cdfb-2f63-492a-a5db-62fade346e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:54 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929228f3-b6fd-451e-bc30-f5ed594f90a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:54 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Volume volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46 (c3f8062d-e7be-4ec8-8f10-06a0babcaf46): created successfully Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929228f3-b6fd-451e-bc30-f5ed594f90a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:54 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Flow 'volume_create_manager' (4af73990-fb7f-4bb2-adb3-5c841db5c002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:54 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-afed249a-1db8-44d5-a40a-c2c6e2990116 tempest-CreateVolumesFromImageTest-779181033 None] Created volume successfully. Apr 29 10:41:55 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea 1073741824" returned: 0 in 0.873s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:55 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea Apr 29 10:41:55 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:56 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea" returned: 0 in 0.656s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.401s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-496554432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31018189-3b84-40f2-9ea1-a7f418e0925d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bce460fc2b4a82bd3d01f3b0a9992d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:51Z,use_quota=True,user_id='58dce4f62b374ac2a6e270daca9f9cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Creating volume 31018189-3b84-40f2-9ea1-a7f418e0925d {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:56 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c810363-8a97-47bb-a4e7-150e9ee13bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ac5d21-b62f-4c50-9e64-e04d44af96a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:56 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d 1073741824 Apr 29 10:41:56 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:56 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Volume volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea (c95b0bf5-ab4e-4d27-9c47-9344d43a0dea): created successfully Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ac5d21-b62f-4c50-9e64-e04d44af96a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:56 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Flow 'volume_create_manager' (1067e304-8061-4547-a8ca-97dc66e6b00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:56 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-597c950f-d027-4828-bd62-fd2c080ace55 tempest-CreateVolumesFromImageTest-779181033 None] Created volume successfully. Apr 29 10:41:57 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d 1073741824" returned: 0 in 0.951s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:57 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d Apr 29 10:41:57 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:57 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d" returned: 0 in 0.599s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.639s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1038862940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6eb400f-a51a-4413-8a30-e21e2df7885b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bce460fc2b4a82bd3d01f3b0a9992d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:51Z,use_quota=True,user_id='58dce4f62b374ac2a6e270daca9f9cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Creating volume d6eb400f-a51a-4413-8a30-e21e2df7885b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:57 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:57 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b 1073741824 Apr 29 10:41:57 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c65e19a-64f5-4c9c-b55e-3f82dbd58ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31018189-3b84-40f2-9ea1-a7f418e0925d', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:57 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9020e287-dd0e-40ae-b005-91341ce5f850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:58 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Volume volume-31018189-3b84-40f2-9ea1-a7f418e0925d (31018189-3b84-40f2-9ea1-a7f418e0925d): created successfully Apr 29 10:41:58 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9020e287-dd0e-40ae-b005-91341ce5f850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:58 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Flow 'volume_create_manager' (2ef0f62f-b526-4022-a61d-2db328927b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:58 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-685b7e23-d8c8-46c9-b6db-8dd722279874 tempest-CreateVolumesFromImageTest-779181033 None] Created volume successfully. Apr 29 10:41:58 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b 1073741824" returned: 0 in 0.898s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:58 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b Apr 29 10:41:58 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:59 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b" returned: 0 in 0.656s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.739s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1319458447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d441cb14-c4a6-4f01-be0f-6a89b3f35bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14bce460fc2b4a82bd3d01f3b0a9992d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:41:52Z,use_quota=True,user_id='58dce4f62b374ac2a6e270daca9f9cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Creating volume d441cb14-c4a6-4f01-be0f-6a89b3f35bef {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:41:59 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:41:59 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef 1073741824 Apr 29 10:41:59 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509c8014-ca2c-40fe-a806-c290dc310145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6eb400f-a51a-4413-8a30-e21e2df7885b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e325b0-58c3-47ed-837e-d15d4acf56e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:41:59 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Volume volume-d6eb400f-a51a-4413-8a30-e21e2df7885b (d6eb400f-a51a-4413-8a30-e21e2df7885b): created successfully Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e325b0-58c3-47ed-837e-d15d4acf56e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:41:59 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Flow 'volume_create_manager' (063312d4-7e68-47af-9119-00e954d91a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:41:59 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e4562773-81f4-4e6d-aa35-23ef13608104 tempest-CreateVolumesFromImageTest-779181033 None] Created volume successfully. Apr 29 10:42:00 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef 1073741824" returned: 0 in 0.853s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:00 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef Apr 29 10:42:00 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:01 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef" returned: 0 in 0.599s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a34285f-8e1b-4277-bfa6-f6ee7c7e35ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d2d87d-6eba-4d0e-81dd-742874fe0ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Creating offline snapshot d09b2430-24d1-4f6b-841e-68b74c74a124 of volume bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:42:01 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Volume volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef (d441cb14-c4a6-4f01-be0f-6a89b3f35bef): created successfully Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d2d87d-6eba-4d0e-81dd-742874fe0ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Flow 'volume_create_manager' (846fe3cd-b621-4878-a54f-258e2c95ebda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8023ba2f-0e79-4964-8c1f-4759a645dfe4]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:01 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6314abed-d1a4-49a8-9b59-c122b82693d0 tempest-CreateVolumesFromImageTest-779181033 None] Created volume successfully. Apr 29 10:42:01 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b Apr 29 10:42:01 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "cinder-d441cb14-c4a6-4f01-be0f-6a89b3f35bef-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-d441cb14-c4a6-4f01-be0f-6a89b3f35bef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "cinder-quobyte-d441cb14-c4a6-4f01-be0f-6a89b3f35bef" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-quobyte-d441cb14-c4a6-4f01-be0f-6a89b3f35bef" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fb951e-0c6a-48ab-b261-c876d5bd7480]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:01 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef Apr 29 10:42:01 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:01 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b" returned: 0 in 0.813s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:01 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 1G Apr 29 10:42:01 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:02 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef" returned: 0 in 0.723s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:02 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef Apr 29 10:42:02 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:02 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 1G" returned: 0 in 0.796s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:02 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc227b64-f741-49b3-b056-a9843dfd7a2b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:02 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc227b64-f741-49b3-b056-a9843dfd7a2b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 Apr 29 10:42:02 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:03 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d441cb14-c4a6-4f01-be0f-6a89b3f35bef" returned: 0 in 0.697s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-quobyte-d441cb14-c4a6-4f01-be0f-6a89b3f35bef" released by "delete_volume" :: held 1.467s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Created reservations ['c21b8b04-fe2d-4ae2-ad97-c20f9b6c05cb', '06b16784-cfa5-442f-a4bb-36a72b898f44', '2291642c-e85e-40b2-bedf-91a98acfb764', '40ca2369-bb1f-43ec-95ae-f2725bc50dad'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:03 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:03 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:03 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc227b64-f741-49b3-b056-a9843dfd7a2b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124" returned: 0 in 0.711s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:03 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 is being set with open permissions: ugo+rw Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:03 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 Apr 29 10:42:03 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "cinder-d6eb400f-a51a-4413-8a30-e21e2df7885b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-d6eb400f-a51a-4413-8a30-e21e2df7885b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "cinder-quobyte-d6eb400f-a51a-4413-8a30-e21e2df7885b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-quobyte-d6eb400f-a51a-4413-8a30-e21e2df7885b" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0505bf0-e47b-474f-b718-75f7494374d7]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:03 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.729s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:03 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:03 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Deleted volume successfully. Apr 29 10:42:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-afb43112-e2c0-4ed8-ac99-2ab4427acb19 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-d441cb14-c4a6-4f01-be0f-6a89b3f35bef-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:04 devstack sudo[92793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b Apr 29 10:42:04 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:04 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124" returned: 0 in 0.675s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:04 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.info Apr 29 10:42:04 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:04 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b" returned: 0 in 0.915s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:04 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b Apr 29 10:42:04 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:05 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.info" returned: 0 in 0.840s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:05 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.info is being set with open permissions: ugo+rw Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:05 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.info Apr 29 10:42:05 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:05 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d6eb400f-a51a-4413-8a30-e21e2df7885b" returned: 0 in 0.791s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:05 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.info" returned: 0 in 0.661s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.624s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-quobyte-d6eb400f-a51a-4413-8a30-e21e2df7885b" released by "delete_volume" :: held 1.794s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.451s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Creating offline snapshot 964ffc90-9b8e-4778-bb04-b1535a2112f6 of volume 55ee0b5e-37ca-4772-89fd-1ff97be2639d {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[38514274-730a-46d8-84d8-c4495384e736]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d963f61e-fadf-43eb-add6-f47ea78dbd98 tempest-VolumeDependencyTests-151890374 None] Create snapshot completed successfully Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Created reservations ['8b368e8a-385d-4343-b8c3-12f46e553f3e', '4d6b616f-4628-40c4-8eda-b3a394d198e0', '580baad5-9dd1-4008-9089-8c30b8c2746c', 'ce193707-16be-4043-afcd-c9b253a2ff6c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:05 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d Apr 29 10:42:05 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:05 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:05 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "cinder-31018189-3b84-40f2-9ea1-a7f418e0925d-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-31018189-3b84-40f2-9ea1-a7f418e0925d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "cinder-quobyte-31018189-3b84-40f2-9ea1-a7f418e0925d" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-quobyte-31018189-3b84-40f2-9ea1-a7f418e0925d" acquired by "delete_volume" :: waited 0.039s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:06 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1f4576-7926-4952-bf81-3c578ff565d4]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:06 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d Apr 29 10:42:06 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:06 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.802s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:06 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:06 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Deleted volume successfully. Apr 29 10:42:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-28002bfb-4fd7-4da9-ba4e-be95881c5bd6 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-d6eb400f-a51a-4413-8a30-e21e2df7885b-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:07 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d" returned: 0 in 1.234s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:07 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 1G Apr 29 10:42:07 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:07 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Flow 'volume_create_manager' (286a9bc6-e69a-4c83-a5c7-085fb439f876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa594d0-eb47-4cf5-b5e2-373920373f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d" returned: 0 in 1.216s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa594d0-eb47-4cf5-b5e2-373920373f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-801857342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f51977-fd10-4342-b545-855c6dd95222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062586f371bb4936a1d52cc972ef3809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d09b2430-24d1-4f6b-841e-68b74c74a124,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:07Z,use_quota=True,user_id='4f8193ab8eb84ed695afee7c6d33c629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:07 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d Apr 29 10:42:07 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ed60aa-2444-4dfb-af2f-e33444985a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ed60aa-2444-4dfb-af2f-e33444985a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26fa40b-5f13-45db-af42-b7514825dadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26fa40b-5f13-45db-af42-b7514825dadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55f51977-fd10-4342-b545-855c6dd95222', 'volume_name': 'volume-55f51977-fd10-4342-b545-855c6dd95222', 'volume_size': 1, 'snapshot_id': 'd09b2430-24d1-4f6b-841e-68b74c74a124'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfb4008-9ec8-4177-a65f-dde29f783214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfb4008-9ec8-4177-a65f-dde29f783214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e5dc52-1857-41cb-bec2-c07017e0dddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:07 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Volume 55f51977-fd10-4342-b545-855c6dd95222: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55f51977-fd10-4342-b545-855c6dd95222', 'volume_size': 1, 'snapshot_id': 'd09b2430-24d1-4f6b-841e-68b74c74a124'} Apr 29 10:42:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:08 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 1G" returned: 0 in 1.162s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:08 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 Apr 29 10:42:08 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:08 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31018189-3b84-40f2-9ea1-a7f418e0925d" returned: 0 in 0.719s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-quobyte-31018189-3b84-40f2-9ea1-a7f418e0925d" released by "delete_volume" :: held 2.014s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Created reservations ['571e03af-b578-48ed-b6f7-79a09e7ef882', '337b1e91-861f-4ed5-9672-dda68a3dee1b', '0e67d208-a484-4459-9fcd-702dc6c11e64', '7f76f69d-890f-46a5-8f89-7fdf5b8c7b7d'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:08 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:08 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "cinder-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "cinder-quobyte-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-quobyte-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fc6172-0b05-4daa-93d8-c5ccf457579c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:08 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea Apr 29 10:42:08 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:09 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6" returned: 0 in 1.084s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:09 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 is being set with open permissions: ugo+rw Apr 29 10:42:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:09 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 Apr 29 10:42:09 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:09 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.920s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:09 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:09 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Deleted volume successfully. Apr 29 10:42:09 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3c5aa033-01cb-4fcc-bca5-194ec5f6c872 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-31018189-3b84-40f2-9ea1-a7f418e0925d-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:09 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea" returned: 0 in 1.020s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:09 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea Apr 29 10:42:09 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:09 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6" returned: 0 in 0.705s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:10 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.info Apr 29 10:42:10 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Flow 'volume_create_manager' (b3361733-517c-4b22-a43a-2376a1ea5ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd9e0ac-bc55-45a5-a3fd-c4f77123c223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd9e0ac-bc55-45a5-a3fd-c4f77123c223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-200988315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33da6ac1-af7a-4684-8705-bea445da5f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9f92ca7e9848a7a8b450eb9215a3b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:10Z,use_quota=True,user_id='a5b511a3903c4b9daa536fd9c9b22633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68cd4e6-bc6c-4db6-b84e-d5bd19f780df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68cd4e6-bc6c-4db6-b84e-d5bd19f780df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbcf051-3cf7-479e-9c06-6510bf8be682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbcf051-3cf7-479e-9c06-6510bf8be682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33da6ac1-af7a-4684-8705-bea445da5f9b', 'volume_name': 'volume-33da6ac1-af7a-4684-8705-bea445da5f9b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9094dfde-82e7-43e1-91ba-0e623f091a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9094dfde-82e7-43e1-91ba-0e623f091a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d4b874-f3b2-4124-bc0e-3cf15ab04687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:10 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Volume 33da6ac1-af7a-4684-8705-bea445da5f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33da6ac1-af7a-4684-8705-bea445da5f9b', 'volume_size': 1} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:10 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea" returned: 0 in 0.672s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-quobyte-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea" released by "delete_volume" :: held 1.741s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Created reservations ['a304d97d-984a-4923-94ac-68f68f6f63f4', '038500d7-d3bc-4615-b040-92e62bde5ef8', '4b4fd61d-ce92-43e7-b21d-606f204fdc79', '4faa8258-c0a3-45ca-b468-43b13b2c7cc2'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:10 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:10 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:10 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.info" returned: 0 in 0.616s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:10 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.info is being set with open permissions: ugo+rw Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:10 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.info Apr 29 10:42:10 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "cinder-c3f8062d-e7be-4ec8-8f10-06a0babcaf46-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-c3f8062d-e7be-4ec8-8f10-06a0babcaf46-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "cinder-quobyte-c3f8062d-e7be-4ec8-8f10-06a0babcaf46" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-quobyte-c3f8062d-e7be-4ec8-8f10-06a0babcaf46" acquired by "delete_volume" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdbeed1-a3c4-435b-8eee-c71ace46bd1e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:11 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46 Apr 29 10:42:11 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:11 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.582s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:11 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Deleted volume successfully. Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5de295cf-f566-4d0e-b478-1b32129fbfcf tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-c95b0bf5-ab4e-4d27-9c47-9344d43a0dea-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:11 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.info" returned: 0 in 0.627s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.571s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.643s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-quobyte-d09b2430-24d1-4f6b-841e-68b74c74a124-55f51977-fd10-4342-b545-855c6dd95222" by "_create_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-d09b2430-24d1-4f6b-841e-68b74c74a124-55f51977-fd10-4342-b545-855c6dd95222" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Creating volume 55f51977-fd10-4342-b545-855c6dd95222 from snapshot d09b2430-24d1-4f6b-841e-68b74c74a124 {{(pid=83806) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-quobyte-55f51977-fd10-4342-b545-855c6dd95222" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:11 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7ec3212a-ebdd-470b-b547-67790c2ea386 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Create snapshot completed successfully Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-55f51977-fd10-4342-b545-855c6dd95222" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] snapshot: d09b2430-24d1-4f6b-841e-68b74c74a124, volume: 55f51977-fd10-4342-b545-855c6dd95222, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[901b05a1-a269-4790-8053-1833111b6609]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:11 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 Apr 29 10:42:11 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:11 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46" returned: 0 in 0.785s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:11 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46 Apr 29 10:42:11 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:12 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124" returned: 0 in 0.716s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc227b64-f741-49b3-b056-a9843dfd7a2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e593e83-afe1-4510-9c26-16279c43b253]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:12 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b Apr 29 10:42:12 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:12 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c3f8062d-e7be-4ec8-8f10-06a0babcaf46" returned: 0 in 0.727s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (19d88a8b-b2e0-4e59-a484-3102510be07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf269c68-cb81-45e2-b16a-e35aa083afea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-quobyte-c3f8062d-e7be-4ec8-8f10-06a0babcaf46" released by "delete_volume" :: held 1.593s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf269c68-cb81-45e2-b16a-e35aa083afea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583324933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f065667b-9d22-44b8-b8a2-0da97db2b12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:12Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674e594-e8bd-413a-84fa-62bbb9828147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d674e594-e8bd-413a-84fa-62bbb9828147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906ed43e-06d7-4e99-a9bb-fa3e980cc86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906ed43e-06d7-4e99-a9bb-fa3e980cc86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f065667b-9d22-44b8-b8a2-0da97db2b12b', 'volume_name': 'volume-f065667b-9d22-44b8-b8a2-0da97db2b12b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ee64e8-c5e0-4d16-83e9-a64ddd9951b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ee64e8-c5e0-4d16-83e9-a64ddd9951b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292c61d7-da54-4d8c-b319-b64081920cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:12 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume f065667b-9d22-44b8-b8a2-0da97db2b12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f065667b-9d22-44b8-b8a2-0da97db2b12b', 'volume_size': 1} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Created reservations ['eca461bc-7306-41f8-8262-ca4ba7cb2025', 'ec4cb45e-b21d-4275-81b3-c1d6ee311b7b', '847dd19b-fb3a-405d-8ae9-ccb5b310bc45', 'ef30a05f-5bc5-4d41-bd2b-cee6aceea3f1'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:12 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:12 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (5c427935-4d4a-4f31-8f8b-74c6188e99ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab13a6f8-234a-487b-8613-eecfa5c7a400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab13a6f8-234a-487b-8613-eecfa5c7a400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1034219045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31507c86-6a3d-4895-aba6-91f1a122b1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:13Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fa746c-54d2-406e-8d62-57a3e0e75608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fa746c-54d2-406e-8d62-57a3e0e75608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9e2d59-7479-4d0a-b7fe-58802b0dac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9e2d59-7479-4d0a-b7fe-58802b0dac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31507c86-6a3d-4895-aba6-91f1a122b1c7', 'volume_name': 'volume-31507c86-6a3d-4895-aba6-91f1a122b1c7', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e2666d-3916-4708-a275-3cfbe12af6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e2666d-3916-4708-a275-3cfbe12af6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfa1208-d97b-454d-a847-92f98964e60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:12 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume 31507c86-6a3d-4895-aba6-91f1a122b1c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31507c86-6a3d-4895-aba6-91f1a122b1c7', 'volume_size': 1} Apr 29 10:42:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:12 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b" returned: 0 in 0.852s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:13 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 Apr 29 10:42:13 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (af79f465-c24b-496b-ab8b-0e3f88ceb56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60da637d-7df4-4e7d-9c74-0d1f4064ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60da637d-7df4-4e7d-9c74-0d1f4064ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-528935194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591bb59f-b67a-498e-bb54-c1d302ef505c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:13Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f712637-7cf8-4168-88dd-36d7482641c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f712637-7cf8-4168-88dd-36d7482641c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42147e2-7e39-40a9-a861-66925bdc9e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42147e2-7e39-40a9-a861-66925bdc9e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591bb59f-b67a-498e-bb54-c1d302ef505c', 'volume_name': 'volume-591bb59f-b67a-498e-bb54-c1d302ef505c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebd9ece-4a17-4e0b-99a3-426b11948879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebd9ece-4a17-4e0b-99a3-426b11948879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931b7940-80ab-4414-8b06-ccdf0f04a24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:13 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:13 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume 591bb59f-b67a-498e-bb54-c1d302ef505c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591bb59f-b67a-498e-bb54-c1d302ef505c', 'volume_size': 1} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.738s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:13 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Deleted volume successfully. Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-736d00f0-76dd-4268-a663-6de2dcdf6958 tempest-CreateVolumesFromImageTest-779181033 None] Lock "cinder-c3f8062d-e7be-4ec8-8f10-06a0babcaf46-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (20288319-352e-43f9-a520-809200691ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5611396b-8b84-457f-be4d-964ff0f996f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5611396b-8b84-457f-be4d-964ff0f996f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2111690401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35effccc-dcfa-42be-b513-5508c7337b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:14Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f307b1cd-62f8-4b39-a938-6a3f02ed86bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f307b1cd-62f8-4b39-a938-6a3f02ed86bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65c1e8e-3d5b-4530-861c-1deba2fbcf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65c1e8e-3d5b-4530-861c-1deba2fbcf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35effccc-dcfa-42be-b513-5508c7337b87', 'volume_name': 'volume-35effccc-dcfa-42be-b513-5508c7337b87', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e29484-0877-410d-89ff-aaefaf5a188f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e29484-0877-410d-89ff-aaefaf5a188f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b4186c-b85e-4558-a576-f00553c06a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:14 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume 35effccc-dcfa-42be-b513-5508c7337b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35effccc-dcfa-42be-b513-5508c7337b87', 'volume_size': 1} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (3100faa0-4c53-4c4e-8a0a-2fc3ba899348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d675c84-1e81-4c8d-9a40-19c981b050d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d675c84-1e81-4c8d-9a40-19c981b050d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733152991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3aa361-eedd-417c-ba59-a8302211303e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:15Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93884f5a-10da-4537-b75c-bdc3a1ca86e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93884f5a-10da-4537-b75c-bdc3a1ca86e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1752615-99fa-455e-be1e-4179e03dc430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1752615-99fa-455e-be1e-4179e03dc430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3aa361-eedd-417c-ba59-a8302211303e', 'volume_name': 'volume-ff3aa361-eedd-417c-ba59-a8302211303e', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4b87da-e415-4334-a2e5-c71d8a7a1fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4b87da-e415-4334-a2e5-c71d8a7a1fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2dad76f-8f2a-457d-ad7d-bda6a8176075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:14 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume ff3aa361-eedd-417c-ba59-a8302211303e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3aa361-eedd-417c-ba59-a8302211303e', 'volume_size': 1} Apr 29 10:42:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:18 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222" returned: 0 in 5.654s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:18 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e34ddaf-588a-4afe-be55-5d971d6d4cc9]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:18 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b Apr 29 10:42:18 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:18 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (b40f4bfe-33d7-41f4-8c45-2093b20e41d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce54e79-24de-4e39-9ba3-6e5e59be9b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce54e79-24de-4e39-9ba3-6e5e59be9b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607884285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cefba78-0ab5-4232-96e2-ac79fab1dcf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:19Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00acfdb-5844-41de-ab7c-cec3f5cab1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00acfdb-5844-41de-ab7c-cec3f5cab1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcee29a-7595-40ef-ad89-0ec8fd3c92fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcee29a-7595-40ef-ad89-0ec8fd3c92fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cefba78-0ab5-4232-96e2-ac79fab1dcf9', 'volume_name': 'volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5854ffba-3c4c-4807-a2a4-ece58f60edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5854ffba-3c4c-4807-a2a4-ece58f60edb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a20f0a-60cd-446c-9162-dfb551063a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:19 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume 0cefba78-0ab5-4232-96e2-ac79fab1dcf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9', 'volume_size': 1} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:19 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b" returned: 0 in 0.899s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:42:19 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Converted 1024.00 MB image at 181.07 MB/s Apr 29 10:42:19 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 is being set with open permissions: ugo+rw Apr 29 10:42:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:19 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 Apr 29 10:42:19 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:20 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222" returned: 0 in 0.613s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-55f51977-fd10-4342-b545-855c6dd95222" released by "_copy_volume_from_snapshot" :: held 8.840s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-d09b2430-24d1-4f6b-841e-68b74c74a124-55f51977-fd10-4342-b545-855c6dd95222" released by "_create_volume_from_snapshot" :: held 8.872s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.901s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.065s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-200988315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33da6ac1-af7a-4684-8705-bea445da5f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9f92ca7e9848a7a8b450eb9215a3b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:10Z,use_quota=True,user_id='a5b511a3903c4b9daa536fd9c9b22633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Creating volume 33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:20 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:20 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b 1073741824 Apr 29 10:42:20 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e5dc52-1857-41cb-bec2-c07017e0dddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f51977-fd10-4342-b545-855c6dd95222', 'volume_size': 1, 'snapshot_id': 'd09b2430-24d1-4f6b-841e-68b74c74a124'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d169df-bf89-438b-94d8-5cf93f9b8f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:20 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Volume volume-55f51977-fd10-4342-b545-855c6dd95222 (55f51977-fd10-4342-b545-855c6dd95222): created successfully Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d169df-bf89-438b-94d8-5cf93f9b8f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Flow 'volume_create_manager' (286a9bc6-e69a-4c83-a5c7-085fb439f876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:20 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-aef8cb30-fc42-4b3b-9803-7cd99f89ebe9 tempest-VolumeDependencyTests-151890374 None] Created volume successfully. Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-d09b2430-24d1-4f6b-841e-68b74c74a124-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-d09b2430-24d1-4f6b-841e-68b74c74a124-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-quobyte-bc227b64-f741-49b3-b056-a9843dfd7a2b" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-bc227b64-f741-49b3-b056-a9843dfd7a2b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-quobyte-d09b2430-24d1-4f6b-841e-68b74c74a124" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-d09b2430-24d1-4f6b-841e-68b74c74a124" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Deleting offline snapshot d09b2430-24d1-4f6b-841e-68b74c74a124 of volume bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] snapshot_file for this snap is: volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c561db9-ed25-4ccc-a59f-a4518165d9f5]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:20 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 Apr 29 10:42:20 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:20 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b 1073741824" returned: 0 in 0.782s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:21 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b Apr 29 10:42:21 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:21 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124" returned: 0 in 0.748s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc227b64-f741-49b3-b056-a9843dfd7a2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d2838e-4374-4b3a-9f53-5c03dcb3bb65]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:21 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b Apr 29 10:42:21 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:21 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b" returned: 0 in 0.630s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.137s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583324933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f065667b-9d22-44b8-b8a2-0da97db2b12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:12Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Creating volume f065667b-9d22-44b8-b8a2-0da97db2b12b {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:21 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d4b874-f3b2-4124-bc0e-3cf15ab04687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33da6ac1-af7a-4684-8705-bea445da5f9b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:21 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b 1073741824 Apr 29 10:42:21 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c80339-0e29-4819-b730-ddec94edd55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:21 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Volume volume-33da6ac1-af7a-4684-8705-bea445da5f9b (33da6ac1-af7a-4684-8705-bea445da5f9b): created successfully Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c80339-0e29-4819-b730-ddec94edd55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:21 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Flow 'volume_create_manager' (b3361733-517c-4b22-a43a-2376a1ea5ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:21 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7b1aa984-e8cc-4c53-8c52-b436779933d9 tempest-SnapshotDependencyTests-588067298 None] Created volume successfully. Apr 29 10:42:22 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b" returned: 0 in 0.720s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:22 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 Apr 29 10:42:22 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:22 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b 1073741824" returned: 0 in 0.869s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:22 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b Apr 29 10:42:22 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:22 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124" returned: 0 in 0.764s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:22 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124 Apr 29 10:42:22 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:23 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b" returned: 0 in 0.591s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.230s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1034219045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31507c86-6a3d-4895-aba6-91f1a122b1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:13Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Creating volume 31507c86-6a3d-4895-aba6-91f1a122b1c7 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:23 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292c61d7-da54-4d8c-b319-b64081920cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f065667b-9d22-44b8-b8a2-0da97db2b12b', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:23 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7 1073741824 Apr 29 10:42:23 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e63598-d032-4439-bcc4-b22bfd72a8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:23 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume volume-f065667b-9d22-44b8-b8a2-0da97db2b12b (f065667b-9d22-44b8-b8a2-0da97db2b12b): created successfully Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e63598-d032-4439-bcc4-b22bfd72a8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (19d88a8b-b2e0-4e59-a484-3102510be07d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-065d0be9-2347-490b-b3de-b497db022966 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created volume successfully. Apr 29 10:42:23 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b.d09b2430-24d1-4f6b-841e-68b74c74a124" returned: 0 in 0.630s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-d09b2430-24d1-4f6b-841e-68b74c74a124" released by "_delete_snapshot" :: held 2.964s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-bc227b64-f741-49b3-b056-a9843dfd7a2b" released by "delete_snapshot" :: held 2.991s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Created reservations ['cbc3eee6-1d7a-4280-b86e-fa905902f96b', '1aa6adaa-b0c8-47b0-b0fd-79b1e214cb1a', 'fe81a893-2ae8-4f84-8a2f-8cae58a8c52c', '6a3d8b4c-031f-4180-9511-b55cf98002cc'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Delete snapshot completed successfully. Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-830cf9d2-c2f5-4875-b2f1-3d701b3fc0f4 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-d09b2430-24d1-4f6b-841e-68b74c74a124-delete_snapshot" released by "delete_snapshot" :: held 3.135s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-bc227b64-f741-49b3-b056-a9843dfd7a2b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-bc227b64-f741-49b3-b056-a9843dfd7a2b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-quobyte-bc227b64-f741-49b3-b056-a9843dfd7a2b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-bc227b64-f741-49b3-b056-a9843dfd7a2b" acquired by "delete_volume" :: waited 0.012s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3a2821-77d3-4e4b-88c1-b2fc6975c81e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:23 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b Apr 29 10:42:23 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:23 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7 1073741824" returned: 0 in 0.803s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:24 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7 Apr 29 10:42:24 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:24 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b" returned: 0 in 0.710s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:24 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b Apr 29 10:42:24 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:24 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7" returned: 0 in 0.597s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.226s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-528935194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591bb59f-b67a-498e-bb54-c1d302ef505c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:13Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Creating volume 591bb59f-b67a-498e-bb54-c1d302ef505c {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:24 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:24 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c 1073741824 Apr 29 10:42:24 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfa1208-d97b-454d-a847-92f98964e60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31507c86-6a3d-4895-aba6-91f1a122b1c7', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6201d73-c9cf-46ec-9907-f12f5824c642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:24 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume volume-31507c86-6a3d-4895-aba6-91f1a122b1c7 (31507c86-6a3d-4895-aba6-91f1a122b1c7): created successfully Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6201d73-c9cf-46ec-9907-f12f5824c642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:24 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (5c427935-4d4a-4f31-8f8b-74c6188e99ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:24 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-21a93416-ff18-4f64-ba24-f3cfc75ef13d tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created volume successfully. Apr 29 10:42:25 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc227b64-f741-49b3-b056-a9843dfd7a2b" returned: 0 in 0.563s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-bc227b64-f741-49b3-b056-a9843dfd7a2b" released by "delete_volume" :: held 1.329s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Created reservations ['1a72ef75-c13a-4afb-a502-83ca2839bb92', 'ee4a80a2-d6f9-42a4-9b33-33ec80de7a20', '7afb6fcb-b65a-4ed5-bee4-049078bef1af', '287afcb4-fb7d-42c1-a29c-c4bfe2236e36'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:25 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:25 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:25 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c 1073741824" returned: 0 in 0.768s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:25 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c Apr 29 10:42:25 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:25 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.594s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:25 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Deleted volume successfully. Apr 29 10:42:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-5ca857bd-c5be-4ea3-a84f-e35905c551d0 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-bc227b64-f741-49b3-b056-a9843dfd7a2b-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:26 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c" returned: 0 in 0.619s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.946s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2111690401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35effccc-dcfa-42be-b513-5508c7337b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:14Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Creating volume 35effccc-dcfa-42be-b513-5508c7337b87 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:26 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:26 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87 1073741824 Apr 29 10:42:26 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931b7940-80ab-4414-8b06-ccdf0f04a24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591bb59f-b67a-498e-bb54-c1d302ef505c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd42c89e-5545-4d3f-8644-3239d3222b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:26 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume volume-591bb59f-b67a-498e-bb54-c1d302ef505c (591bb59f-b67a-498e-bb54-c1d302ef505c): created successfully Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd42c89e-5545-4d3f-8644-3239d3222b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (af79f465-c24b-496b-ab8b-0e3f88ceb56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:26 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-9422c6e3-ffa2-4a16-ae45-74ff253d03d1 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created volume successfully. Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Flow 'volume_create_manager' (5d087eb9-1654-47d8-93a1-505019aedb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72aaba2-668c-4b5e-9e3d-a1708b06fbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72aaba2-668c-4b5e-9e3d-a1708b06fbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1012502660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da6e0d0-2359-4782-be86-63292117471a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062586f371bb4936a1d52cc972ef3809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:26Z,use_quota=True,user_id='4f8193ab8eb84ed695afee7c6d33c629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b22dbaa-5323-48ff-aa2c-5f7697bf37c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b22dbaa-5323-48ff-aa2c-5f7697bf37c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1fe31b-d97e-428f-af27-22133ed3e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1fe31b-d97e-428f-af27-22133ed3e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da6e0d0-2359-4782-be86-63292117471a', 'volume_name': 'volume-5da6e0d0-2359-4782-be86-63292117471a', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79138402-bd46-4dae-adaa-27f70c631978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79138402-bd46-4dae-adaa-27f70c631978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e450abc4-f105-4dd5-be39-a47d49091b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:26 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Volume 5da6e0d0-2359-4782-be86-63292117471a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da6e0d0-2359-4782-be86-63292117471a', 'volume_size': 1} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:26 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87 1073741824" returned: 0 in 0.777s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:26 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87 Apr 29 10:42:26 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:27 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87" returned: 0 in 0.563s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.590s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-733152991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3aa361-eedd-417c-ba59-a8302211303e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8805979a062047629c6983941dd98d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:15Z,use_quota=True,user_id='38132c2703aa42728acc8207dc94119c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Creating volume ff3aa361-eedd-417c-ba59-a8302211303e {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:27 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b4186c-b85e-4558-a576-f00553c06a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35effccc-dcfa-42be-b513-5508c7337b87', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:27 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e 1073741824 Apr 29 10:42:27 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775ee7f7-1341-4aa9-aeff-c23ddca6d6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:27 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume volume-35effccc-dcfa-42be-b513-5508c7337b87 (35effccc-dcfa-42be-b513-5508c7337b87): created successfully Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775ee7f7-1341-4aa9-aeff-c23ddca6d6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:27 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (20288319-352e-43f9-a520-809200691ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:27 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-a25ada39-09be-4103-b516-8705dd006a68 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created volume successfully. Apr 29 10:42:28 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e 1073741824" returned: 0 in 0.745s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:28 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e Apr 29 10:42:28 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:28 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e" returned: 0 in 0.562s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.742s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607884285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cefba78-0ab5-4232-96e2-ac79fab1dcf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:19Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Creating volume 0cefba78-0ab5-4232-96e2-ac79fab1dcf9 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:28 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:28 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9 1073741824 Apr 29 10:42:28 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2dad76f-8f2a-457d-ad7d-bda6a8176075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3aa361-eedd-417c-ba59-a8302211303e', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be215e91-4bb4-4779-947b-f3e29f2aabd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:28 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Volume volume-ff3aa361-eedd-417c-ba59-a8302211303e (ff3aa361-eedd-417c-ba59-a8302211303e): created successfully Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be215e91-4bb4-4779-947b-f3e29f2aabd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:28 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Flow 'volume_create_manager' (3100faa0-4c53-4c4e-8a0a-2fc3ba899348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:28 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d174d559-c9e7-45d2-b808-b783d5c7b289 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created volume successfully. Apr 29 10:42:29 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9 1073741824" returned: 0 in 0.769s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:29 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:29 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9 Apr 29 10:42:29 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-ff3aa361-eedd-417c-ba59-a8302211303e-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-ff3aa361-eedd-417c-ba59-a8302211303e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-quobyte-ff3aa361-eedd-417c-ba59-a8302211303e" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-ff3aa361-eedd-417c-ba59-a8302211303e" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa63c4cd-ffed-408b-9304-a3201e5d5695]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:30 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e Apr 29 10:42:30 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:30 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9" returned: 0 in 0.609s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.888s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a20f0a-60cd-446c-9162-dfb551063a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0853ce9d-bf22-45aa-adf4-8e5ea3582abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Creating offline snapshot f149946e-6489-4e64-b6fe-1692802a3f7d of volume 33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:42:30 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9 (0cefba78-0ab5-4232-96e2-ac79fab1dcf9): created successfully Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0853ce9d-bf22-45aa-adf4-8e5ea3582abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (b40f4bfe-33d7-41f4-8c45-2093b20e41d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[af82e7f5-0bfc-4950-a1c3-950c7906612c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:30 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-87dfcf75-f9dd-454e-9c0a-80d91cd5adfa tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created volume successfully. Apr 29 10:42:30 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b Apr 29 10:42:30 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:30 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e" returned: 0 in 0.755s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:30 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:30 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e Apr 29 10:42:30 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (d4ae5c4a-f7ed-4cd4-a927-d081ad59ccf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4141c81-d5e0-44c6-9533-42bdfbd13153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4141c81-d5e0-44c6-9533-42bdfbd13153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-482243459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708ebf2e-bc28-4467-bcbc-cfc00ff62135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:31Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4582c0e2-7e9d-450f-8caf-9d1adf587e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4582c0e2-7e9d-450f-8caf-9d1adf587e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8bce2e-5109-48a1-9a10-c106f2e1d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea8bce2e-5109-48a1-9a10-c106f2e1d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708ebf2e-bc28-4467-bcbc-cfc00ff62135', 'volume_name': 'volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cee6c3c-ac26-4dbf-b934-acff28dbc2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cee6c3c-ac26-4dbf-b934-acff28dbc2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768056f6-9f12-4489-81fc-2d541b8bd9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume 708ebf2e-bc28-4467-bcbc-cfc00ff62135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135', 'volume_size': 1} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:31 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b" returned: 0 in 0.826s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:31 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d 1G Apr 29 10:42:31 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:31 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-ff3aa361-eedd-417c-ba59-a8302211303e" returned: 0 in 0.652s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (1ce989eb-eb88-4642-afec-3bc8270b875f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7332230-4143-42af-a067-76f7dc692cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-ff3aa361-eedd-417c-ba59-a8302211303e" released by "delete_volume" :: held 1.483s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7332230-4143-42af-a067-76f7dc692cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371936323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1655e9-f192-4707-a7ec-b079b9d4fe7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:31Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe1d268-d471-4738-8587-ff2a7fe74f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe1d268-d471-4738-8587-ff2a7fe74f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6410b793-d1b4-4f6a-8fc8-91b1d30f526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6410b793-d1b4-4f6a-8fc8-91b1d30f526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1655e9-f192-4707-a7ec-b079b9d4fe7c', 'volume_name': 'volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b26691-f422-464b-9213-0bed29738f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b26691-f422-464b-9213-0bed29738f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad8a1ea-7d48-4ee8-a412-10eb846573c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume bc1655e9-f192-4707-a7ec-b079b9d4fe7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c', 'volume_size': 1} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created reservations ['870f785f-eccf-491d-8e88-505d2e40344e', 'e5265a02-8751-4f85-b63f-443c81bb32e5', 'a1158d22-acb0-4c37-8c3e-e65f8543f56c', '8bf18635-05bf-4b8d-9e17-d07f64287a0c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:31 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:31 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (6aabeb03-647d-44a4-80c7-cbc6d17fee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5617a3-15a2-4870-be30-37d97ef56063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5617a3-15a2-4870-be30-37d97ef56063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-933767926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dca079-7e03-4367-b9f6-7ae8220c28bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:32Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ac9de4-c443-45c5-b2c0-343b8842a95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ac9de4-c443-45c5-b2c0-343b8842a95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:31 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7b0b87-ade2-4d57-a992-f28de2d3dff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7b0b87-ade2-4d57-a992-f28de2d3dff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95dca079-7e03-4367-b9f6-7ae8220c28bf', 'volume_name': 'volume-95dca079-7e03-4367-b9f6-7ae8220c28bf', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e44134-8269-40ea-bc13-d3c6f259486f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e44134-8269-40ea-bc13-d3c6f259486f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d25f02-0707-4397-a982-aeacdb7d9706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume 95dca079-7e03-4367-b9f6-7ae8220c28bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95dca079-7e03-4367-b9f6-7ae8220c28bf', 'volume_size': 1} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-35effccc-dcfa-42be-b513-5508c7337b87-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:32 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d 1G" returned: 0 in 1.006s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33da6ac1-af7a-4684-8705-bea445da5f9b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:32 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33da6ac1-af7a-4684-8705-bea445da5f9b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d Apr 29 10:42:32 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-35effccc-dcfa-42be-b513-5508c7337b87-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (dfbc493d-eedb-4230-b26f-dd2a10070cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533ac363-64d9-4616-99bb-97c3d5b75821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533ac363-64d9-4616-99bb-97c3d5b75821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-195523018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3f7725-76c6-4837-880c-0858cf447fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:32Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728d97b9-4944-4c30-b700-a1f7c37f328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728d97b9-4944-4c30-b700-a1f7c37f328b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719d2d44-7df5-4020-b856-22fadd91204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719d2d44-7df5-4020-b856-22fadd91204d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c3f7725-76c6-4837-880c-0858cf447fa3', 'volume_name': 'volume-3c3f7725-76c6-4837-880c-0858cf447fa3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02df2246-9e2a-4b6e-8719-17ca056e8017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02df2246-9e2a-4b6e-8719-17ca056e8017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9d0e1c-530a-424e-a4d1-e8c429e29c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume 3c3f7725-76c6-4837-880c-0858cf447fa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c3f7725-76c6-4837-880c-0858cf447fa3', 'volume_size': 1} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-quobyte-35effccc-dcfa-42be-b513-5508c7337b87" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-35effccc-dcfa-42be-b513-5508c7337b87" acquired by "delete_volume" :: waited 0.024s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[787e7b3b-6623-4af8-9f1e-b3a01a1718d4]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:32 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.802s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:32 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Deleted volume successfully. Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6f70984c-e5f8-4fd1-8339-46338b585c40 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-ff3aa361-eedd-417c-ba59-a8302211303e-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:32 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87 Apr 29 10:42:32 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (3c1055c6-b846-4c49-a686-68acd8e622b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c7ce74-1bba-4eaa-b5ac-f3f79da8e763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c7ce74-1bba-4eaa-b5ac-f3f79da8e763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1501594207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f632023-0d01-4373-a830-d35588f79534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:33Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6d2cec-9724-405c-9a51-0a22fc317540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6d2cec-9724-405c-9a51-0a22fc317540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5342e35b-b7c1-485d-b27a-45102556acbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5342e35b-b7c1-485d-b27a-45102556acbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f632023-0d01-4373-a830-d35588f79534', 'volume_name': 'volume-8f632023-0d01-4373-a830-d35588f79534', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee076b5-d6b2-479e-b20e-6ff253b25c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee076b5-d6b2-479e-b20e-6ff253b25c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62da4986-0954-4bed-8d69-9d36d8ff33d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:32 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume 8f632023-0d01-4373-a830-d35588f79534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f632023-0d01-4373-a830-d35588f79534', 'volume_size': 1} Apr 29 10:42:32 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:33 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33da6ac1-af7a-4684-8705-bea445da5f9b -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d" returned: 0 in 0.730s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:33 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d is being set with open permissions: ugo+rw Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:33 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d Apr 29 10:42:33 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:33 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:33 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:33 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87" returned: 0 in 0.752s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:33 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87 Apr 29 10:42:33 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:33 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d" returned: 0 in 0.598s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:33 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.info Apr 29 10:42:33 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:33 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.693s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:33 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-35effccc-dcfa-42be-b513-5508c7337b87" returned: 0 in 0.702s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-35effccc-dcfa-42be-b513-5508c7337b87" released by "delete_volume" :: held 1.508s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created reservations ['da164d39-b6ae-45b0-b09f-158c6d45d552', '548e6fbd-6801-4155-824a-f410ee718daa', 'cd32320f-23b3-4573-be83-932fe2e5a46b', '9a097dfe-e8da-4b1f-ada8-fa3533ec74c6'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:34 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:34 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:34 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.info" returned: 0 in 0.611s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:34 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.info is being set with open permissions: ugo+rw Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:34 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.info Apr 29 10:42:34 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-591bb59f-b67a-498e-bb54-c1d302ef505c-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-591bb59f-b67a-498e-bb54-c1d302ef505c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-quobyte-591bb59f-b67a-498e-bb54-c1d302ef505c" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-591bb59f-b67a-498e-bb54-c1d302ef505c" acquired by "delete_volume" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c62f77-28c6-4812-b496-8e891fb7e1c1]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:34 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c Apr 29 10:42:34 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:34 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.676s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:34 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Deleted volume successfully. Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-6988c159-59ad-40e3-ba8b-fe1fcc112797 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-35effccc-dcfa-42be-b513-5508c7337b87-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:34 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.info" returned: 0 in 0.598s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.497s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.462s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1012502660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da6e0d0-2359-4782-be86-63292117471a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062586f371bb4936a1d52cc972ef3809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:26Z,use_quota=True,user_id='4f8193ab8eb84ed695afee7c6d33c629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Creating volume 5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:34 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:34 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:34 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a 1073741824 Apr 29 10:42:34 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:34 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-7a1403c6-d771-4fcd-a2f3-a74fc73f239f tempest-SnapshotDependencyTests-588067298 None] Create snapshot completed successfully Apr 29 10:42:35 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c" returned: 0 in 0.692s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:35 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c Apr 29 10:42:35 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:35 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a 1073741824" returned: 0 in 0.752s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:35 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a Apr 29 10:42:35 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:35 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:35 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-591bb59f-b67a-498e-bb54-c1d302ef505c" returned: 0 in 0.644s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-591bb59f-b67a-498e-bb54-c1d302ef505c" released by "delete_volume" :: held 1.385s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created reservations ['d9b625b9-df00-4534-bd1c-602c43e56072', 'e16b47ba-ab9c-4c4c-bc79-dcf343ee4fdb', '0e9887da-895a-468d-9c7d-6715f4ac2fe6', '15604031-8e91-45b3-992e-de233eb7a194'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:36 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:36 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:36 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a" returned: 0 in 0.664s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.140s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-482243459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708ebf2e-bc28-4467-bcbc-cfc00ff62135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:31Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Creating volume 708ebf2e-bc28-4467-bcbc-cfc00ff62135 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:36 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e450abc4-f105-4dd5-be39-a47d49091b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da6e0d0-2359-4782-be86-63292117471a', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:36 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135 1073741824 Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81525fff-f711-4efc-89fb-95f01a8c579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:36 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:36 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Volume volume-5da6e0d0-2359-4782-be86-63292117471a (5da6e0d0-2359-4782-be86-63292117471a): created successfully Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81525fff-f711-4efc-89fb-95f01a8c579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Flow 'volume_create_manager' (5d087eb9-1654-47d8-93a1-505019aedb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:36 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-745c4633-78f8-4f7c-ad13-a996c57aaec3 tempest-VolumeDependencyTests-151890374 None] Created volume successfully. Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Flow 'volume_create_manager' (510bb89f-6167-4e3b-8617-c64a97f0fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46eadeb-8cfb-4ed2-b6ca-69f0e8f0abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46eadeb-8cfb-4ed2-b6ca-69f0e8f0abd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ffb43e-d697-443a-b795-847bc09a00c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9f92ca7e9848a7a8b450eb9215a3b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f149946e-6489-4e64-b6fe-1692802a3f7d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:37Z,use_quota=True,user_id='a5b511a3903c4b9daa536fd9c9b22633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f988a6e1-6e84-429e-a233-af81f6160345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f988a6e1-6e84-429e-a233-af81f6160345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefceb04-63fa-4d68-ba43-8b91ba0c3177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefceb04-63fa-4d68-ba43-8b91ba0c3177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3ffb43e-d697-443a-b795-847bc09a00c2', 'volume_name': 'volume-d3ffb43e-d697-443a-b795-847bc09a00c2', 'volume_size': 1, 'snapshot_id': 'f149946e-6489-4e64-b6fe-1692802a3f7d'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5822318f-deaf-4f3c-abd9-13a6b3424a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5822318f-deaf-4f3c-abd9-13a6b3424a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125a46e3-fd30-484a-af48-ac3fe0445611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:36 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Volume d3ffb43e-d697-443a-b795-847bc09a00c2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3ffb43e-d697-443a-b795-847bc09a00c2', 'volume_size': 1, 'snapshot_id': 'f149946e-6489-4e64-b6fe-1692802a3f7d'} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:36 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.638s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-31507c86-6a3d-4895-aba6-91f1a122b1c7-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:36 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Deleted volume successfully. Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-31507c86-6a3d-4895-aba6-91f1a122b1c7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-65846cf7-d345-46d6-8c39-00620ac91671 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-591bb59f-b67a-498e-bb54-c1d302ef505c-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-quobyte-31507c86-6a3d-4895-aba6-91f1a122b1c7" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-31507c86-6a3d-4895-aba6-91f1a122b1c7" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2fea1a-1859-40c5-9ed6-4bf5d8190ae4]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:36 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:37 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7 Apr 29 10:42:37 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:37 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135 1073741824" returned: 0 in 0.882s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:37 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135 Apr 29 10:42:37 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Flow 'volume_create_manager' (90c06bd7-f14a-4d27-9a59-4c05c9bcd866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efff9b64-1ef5-4753-add0-30b031ca74d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efff9b64-1ef5-4753-add0-30b031ca74d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-413958504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7a544d-d2f7-4348-aba6-17d0c0402e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062586f371bb4936a1d52cc972ef3809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5da6e0d0-2359-4782-be86-63292117471a,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:37Z,use_quota=True,user_id='4f8193ab8eb84ed695afee7c6d33c629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40140e6-acd0-441a-a242-ced754678ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40140e6-acd0-441a-a242-ced754678ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b4d56a-fa55-433d-bc9d-0adb4a487018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b4d56a-fa55-433d-bc9d-0adb4a487018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7d7a544d-d2f7-4348-aba6-17d0c0402e99', 'volume_name': 'volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99', 'volume_size': 1, 'source_volid': '5da6e0d0-2359-4782-be86-63292117471a', 'source_volstatus': 'available'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fe6033-1348-4fb2-9106-20aae56aea38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fe6033-1348-4fb2-9106-20aae56aea38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e22f513-6168-444d-88da-9e8ae1898963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:37 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Volume 7d7a544d-d2f7-4348-aba6-17d0c0402e99: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99', 'volume_size': 1, 'source_volid': '5da6e0d0-2359-4782-be86-63292117471a', 'source_volstatus': 'available'} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:37 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7" returned: 0 in 0.787s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:37 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7 Apr 29 10:42:37 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:37 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135" returned: 0 in 0.614s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.277s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371936323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1655e9-f192-4707-a7ec-b079b9d4fe7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:31Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Creating volume bc1655e9-f192-4707-a7ec-b079b9d4fe7c {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:37 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:37 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c 1073741824 Apr 29 10:42:37 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768056f6-9f12-4489-81fc-2d541b8bd9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b303e8-9705-47b9-a70b-f63d967414c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:37 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135 (708ebf2e-bc28-4467-bcbc-cfc00ff62135): created successfully Apr 29 10:42:37 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b303e8-9705-47b9-a70b-f63d967414c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (d4ae5c4a-f7ed-4cd4-a927-d081ad59ccf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:38 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-597c8991-d3e9-4bd2-8152-825bcb8f1c84 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created volume successfully. Apr 29 10:42:38 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-31507c86-6a3d-4895-aba6-91f1a122b1c7" returned: 0 in 0.595s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-31507c86-6a3d-4895-aba6-91f1a122b1c7" released by "delete_volume" :: held 1.424s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created reservations ['cd84cfa1-1b00-43e9-9d86-063fecd68556', '0150761f-6df1-4566-8e7e-5103df0f7b34', '5001654d-0024-4cd0-ae0e-1b013176f4d7', '9b3e1d59-1074-4863-a4f8-8ecc195892f1'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:38 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:38 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:38 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c 1073741824" returned: 0 in 0.770s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:38 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:38 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c Apr 29 10:42:38 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:39 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.609s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:39 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Deleted volume successfully. Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-f065667b-9d22-44b8-b8a2-0da97db2b12b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-f065667b-9d22-44b8-b8a2-0da97db2b12b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-31f31d97-80ea-4dcb-875a-560ff3574229 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-31507c86-6a3d-4895-aba6-91f1a122b1c7-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-quobyte-f065667b-9d22-44b8-b8a2-0da97db2b12b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-f065667b-9d22-44b8-b8a2-0da97db2b12b" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8a3418-ef04-48ff-80c8-b3ec21aaba03]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:39 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b Apr 29 10:42:39 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:39 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c" returned: 0 in 0.632s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.338s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-933767926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dca079-7e03-4367-b9f6-7ae8220c28bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:32Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Creating volume 95dca079-7e03-4367-b9f6-7ae8220c28bf {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:39 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad8a1ea-7d48-4ee8-a412-10eb846573c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381d130d-fd6d-400f-8b11-656e01e59557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:39 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf 1073741824 Apr 29 10:42:39 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:39 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c (bc1655e9-f192-4707-a7ec-b079b9d4fe7c): created successfully Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381d130d-fd6d-400f-8b11-656e01e59557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (1ce989eb-eb88-4642-afec-3bc8270b875f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:39 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f9b82a74-d0b6-49f1-8445-502c2fd9193e tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created volume successfully. Apr 29 10:42:39 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b" returned: 0 in 0.699s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:39 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:39 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b Apr 29 10:42:39 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:40 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf 1073741824" returned: 0 in 0.813s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:40 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf Apr 29 10:42:40 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:40 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-f065667b-9d22-44b8-b8a2-0da97db2b12b" returned: 0 in 0.576s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-f065667b-9d22-44b8-b8a2-0da97db2b12b" released by "delete_volume" :: held 1.320s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created reservations ['7b8b677f-dd02-4529-9d49-57755ff03cfa', '4cdc2a13-64eb-4a8b-a278-09ecd4f985a9', '7607969a-6860-46dd-b4d5-96fbae6c4477', '97696ee7-f906-4b15-b442-cfc09bac0a9d'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:40 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:40 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:40 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf" returned: 0 in 0.630s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.394s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-195523018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3f7725-76c6-4837-880c-0858cf447fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:32Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Creating volume 3c3f7725-76c6-4837-880c-0858cf447fa3 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:40 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:40 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3 1073741824 Apr 29 10:42:40 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d25f02-0707-4397-a982-aeacdb7d9706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dca079-7e03-4367-b9f6-7ae8220c28bf', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae8bb29-066c-421a-af0d-9fe4bff945bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:40 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume volume-95dca079-7e03-4367-b9f6-7ae8220c28bf (95dca079-7e03-4367-b9f6-7ae8220c28bf): created successfully Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae8bb29-066c-421a-af0d-9fe4bff945bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:40 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (6aabeb03-647d-44a4-80c7-cbc6d17fee4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:40 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-87cc59ac-a064-4383-8c3b-7217f4b9aa62 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created volume successfully. Apr 29 10:42:41 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.601s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:41 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Deleted volume successfully. Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-2041e6b7-dae4-4493-89c9-3d54278dd433 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-f065667b-9d22-44b8-b8a2-0da97db2b12b-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-964ffc90-9b8e-4778-bb04-b1535a2112f6-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-964ffc90-9b8e-4778-bb04-b1535a2112f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-quobyte-55ee0b5e-37ca-4772-89fd-1ff97be2639d" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-55ee0b5e-37ca-4772-89fd-1ff97be2639d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-quobyte-964ffc90-9b8e-4778-bb04-b1535a2112f6" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-964ffc90-9b8e-4778-bb04-b1535a2112f6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Deleting offline snapshot 964ffc90-9b8e-4778-bb04-b1535a2112f6 of volume 55ee0b5e-37ca-4772-89fd-1ff97be2639d {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] snapshot_file for this snap is: volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9e355e-de3c-4bff-9fcd-ad3348c09eea]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:41 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 Apr 29 10:42:41 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:41 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3 1073741824" returned: 0 in 0.855s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:41 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:41 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3 Apr 29 10:42:41 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:42 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6" returned: 0 in 0.715s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa1de63-a0fe-40ae-9d11-a0e2d41f3306]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:42 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d Apr 29 10:42:42 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:42 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3" returned: 0 in 0.631s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.427s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1501594207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f632023-0d01-4373-a830-d35588f79534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564b40bfd6e64e428c70564b1c877108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:33Z,use_quota=True,user_id='7c7dd344780c46d39bc0720a0099be6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Creating volume 8f632023-0d01-4373-a830-d35588f79534 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:42 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9d0e1c-530a-424e-a4d1-e8c429e29c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3f7725-76c6-4837-880c-0858cf447fa3', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:42 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534 1073741824 Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c32078f-ceb1-4b9f-9353-e915aaa314e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:42 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:42 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume volume-3c3f7725-76c6-4837-880c-0858cf447fa3 (3c3f7725-76c6-4837-880c-0858cf447fa3): created successfully Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c32078f-ceb1-4b9f-9353-e915aaa314e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (dfbc493d-eedb-4230-b26f-dd2a10070cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:42 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-3a9fff7b-c50f-4419-b115-3a8586f7c916 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created volume successfully. Apr 29 10:42:42 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d" returned: 0 in 0.684s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:42 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:42 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 Apr 29 10:42:42 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:43 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534 1073741824" returned: 0 in 0.774s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:43 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534 Apr 29 10:42:43 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:43 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6" returned: 0 in 0.666s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:43 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6 Apr 29 10:42:43 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:43 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534" returned: 0 in 0.603s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.095s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "cinder-quobyte-f149946e-6489-4e64-b6fe-1692802a3f7d-d3ffb43e-d697-443a-b795-847bc09a00c2" by "_create_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62da4986-0954-4bed-8d69-9d36d8ff33d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f632023-0d01-4373-a830-d35588f79534', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b6c30c-f4b6-4346-8854-27a7d3558724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-f149946e-6489-4e64-b6fe-1692802a3f7d-d3ffb43e-d697-443a-b795-847bc09a00c2" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Creating volume d3ffb43e-d697-443a-b795-847bc09a00c2 from snapshot f149946e-6489-4e64-b6fe-1692802a3f7d {{(pid=83806) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "cinder-quobyte-d3ffb43e-d697-443a-b795-847bc09a00c2" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:43 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Volume volume-8f632023-0d01-4373-a830-d35588f79534 (8f632023-0d01-4373-a830-d35588f79534): created successfully Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b6c30c-f4b6-4346-8854-27a7d3558724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Flow 'volume_create_manager' (3c1055c6-b846-4c49-a686-68acd8e622b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-d3ffb43e-d697-443a-b795-847bc09a00c2" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] snapshot: f149946e-6489-4e64-b6fe-1692802a3f7d, volume: d3ffb43e-d697-443a-b795-847bc09a00c2, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:43 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-bdba2073-72da-4f50-9542-5c2ba8a6c3b9 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created volume successfully. Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d862dbce-8a3d-41d3-bf35-ff82f9cd3731]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:43 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:44 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d.964ffc90-9b8e-4778-bb04-b1535a2112f6" returned: 0 in 0.583s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:44 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d Apr 29 10:42:44 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-964ffc90-9b8e-4778-bb04-b1535a2112f6" released by "_delete_snapshot" :: held 2.765s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-55ee0b5e-37ca-4772-89fd-1ff97be2639d" released by "delete_snapshot" :: held 2.791s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created reservations ['d32abb28-2800-4090-a08e-3041a6f2f29c', 'ffe0368c-766d-4f38-aed5-9e43e29767cf', '6b476363-8e13-400e-81df-b8e58228a0d6', '6194172f-1906-45d3-91a4-d11d0d602530'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:44 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Delete snapshot completed successfully. Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-dc1eda4c-e71a-418c-9c3f-0a194d74db65 tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-964ffc90-9b8e-4778-bb04-b1535a2112f6-delete_snapshot" released by "delete_snapshot" :: held 2.923s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-55ee0b5e-37ca-4772-89fd-1ff97be2639d-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-55ee0b5e-37ca-4772-89fd-1ff97be2639d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "cinder-quobyte-55ee0b5e-37ca-4772-89fd-1ff97be2639d" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-55ee0b5e-37ca-4772-89fd-1ff97be2639d" acquired by "delete_volume" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[519e2296-0f10-414c-baba-01419ca4f4a2]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:44 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d" returned: 0 in 0.684s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33da6ac1-af7a-4684-8705-bea445da5f9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[3908def5-fb6c-4369-a20c-524eb9b8f17a]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:44 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d Apr 29 10:42:44 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-8f632023-0d01-4373-a830-d35588f79534-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-8f632023-0d01-4373-a830-d35588f79534-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:44 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b Apr 29 10:42:44 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-quobyte-8f632023-0d01-4373-a830-d35588f79534" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-8f632023-0d01-4373-a830-d35588f79534" acquired by "delete_volume" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[2569c267-63b0-475d-9909-215ec097d611]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:44 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:45 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534 Apr 29 10:42:45 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:45 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d" returned: 0 in 0.730s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:45 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d Apr 29 10:42:45 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:45 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b" returned: 0 in 0.801s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:45 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:42:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:45 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 Apr 29 10:42:45 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:45 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534" returned: 0 in 0.721s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:45 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534 Apr 29 10:42:45 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:45 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:45 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55ee0b5e-37ca-4772-89fd-1ff97be2639d" returned: 0 in 0.603s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:45 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-quobyte-55ee0b5e-37ca-4772-89fd-1ff97be2639d" released by "delete_volume" :: held 1.407s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Created reservations ['49ac8923-1df7-4c7d-89ef-41da905c7f9a', '8c600d69-7308-4b24-957d-3cee23adcd28', '5932e546-f6e9-4fbe-a3d0-789dbf20b3c1', 'c05df715-837b-4cb8-863d-b912884bff86'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:46 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:46 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:46 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-8f632023-0d01-4373-a830-d35588f79534" returned: 0 in 0.684s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-8f632023-0d01-4373-a830-d35588f79534" released by "delete_volume" :: held 1.461s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created reservations ['fb6ffe79-4c06-4b6e-8da4-7173efb16880', 'ad152025-e624-4957-b505-cd5a3e6d7d95', '2730388f-5bbd-40a2-a502-16c4d3b5099a', '852b94dc-d77e-421d-a048-df8726beedd2'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:46 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:46 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:46 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-3c3f7725-76c6-4837-880c-0858cf447fa3-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-3c3f7725-76c6-4837-880c-0858cf447fa3-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-quobyte-3c3f7725-76c6-4837-880c-0858cf447fa3" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:47 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-3c3f7725-76c6-4837-880c-0858cf447fa3" acquired by "delete_volume" :: waited 0.044s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:47 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[69972787-0744-4941-bd3f-45b5135324f2]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:47 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:48 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3 Apr 29 10:42:48 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:48 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 2.100s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:48 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:48 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Deleted volume successfully. Apr 29 10:42:48 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=182,cinder:SELECT=148,cinder:INSERT=46,cinder:DELETE=16 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:42:48 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-a5b613ac-2d66-436b-a001-a690143546df tempest-CreateVolumesFromSnapshotTest-1958129219 None] Lock "cinder-55ee0b5e-37ca-4772-89fd-1ff97be2639d-delete_volume" released by "delete_volume" :: held 3.838s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:48 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:48 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.667s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:48 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:48 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Deleted volume successfully. Apr 29 10:42:48 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-75de50f1-795c-44be-8ba3-d2b713f239a1 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-8f632023-0d01-4373-a830-d35588f79534-delete_volume" released by "delete_volume" :: held 3.757s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:49 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3" returned: 0 in 1.921s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:49 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:49 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3 Apr 29 10:42:49 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:51 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-3c3f7725-76c6-4837-880c-0858cf447fa3" returned: 0 in 1.661s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-3c3f7725-76c6-4837-880c-0858cf447fa3" released by "delete_volume" :: held 3.687s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=122,cinder:UPDATE=185,cinder:DELETE=21,cinder:INSERT=37 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created reservations ['1b4d8df1-ead8-42f6-8ca0-43c32f07923b', 'f2b0f68c-3417-4e6c-810a-187b0f6acf0f', '864cc90e-ae5e-4d30-ad43-7e7268fa262e', '6e3f6c6e-a116-4a8b-b059-9bbbb834b05c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:51 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2" returned: 0 in 5.867s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[1554fe80-c18f-4ade-a866-1c28df188b5e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:51 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:51 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:51 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:51 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b Apr 29 10:42:51 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:52 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.655s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:52 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Deleted volume successfully. Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-16dfa838-cc5f-4132-83b1-5ceed63061c8 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-3c3f7725-76c6-4837-880c-0858cf447fa3-delete_volume" released by "delete_volume" :: held 4.742s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-95dca079-7e03-4367-b9f6-7ae8220c28bf-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-95dca079-7e03-4367-b9f6-7ae8220c28bf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-quobyte-95dca079-7e03-4367-b9f6-7ae8220c28bf" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-95dca079-7e03-4367-b9f6-7ae8220c28bf" acquired by "delete_volume" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[827915cd-4def-4da4-9cc3-6cac75bdadd1]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:52 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b" returned: 0 in 0.946s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:42:52 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Converted 1024.00 MB image at 174.49 MB/s Apr 29 10:42:52 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 is being set with open permissions: ugo+rw Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:52 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 Apr 29 10:42:52 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:52 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf Apr 29 10:42:52 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Flow 'volume_create_manager' (e1c3ed5a-68a6-4335-91ee-d54b87ca5b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3432d78-c6b9-4611-a40e-1dcb5c8c4dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3432d78-c6b9-4611-a40e-1dcb5c8c4dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb11c745-7d9f-46de-8d25-6ac3bec29778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5e842862154fa583cd3976b69656ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:53Z,use_quota=True,user_id='5a241b1201d24b3da6ca0db9663966dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884c9854-cbcb-42a1-a0bd-d497ad32c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884c9854-cbcb-42a1-a0bd-d497ad32c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323d1b14-6b1b-4a5e-9fcd-1206914b3d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323d1b14-6b1b-4a5e-9fcd-1206914b3d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb11c745-7d9f-46de-8d25-6ac3bec29778', 'volume_name': 'volume-cb11c745-7d9f-46de-8d25-6ac3bec29778', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b21581-4811-4f06-925a-0c465cea78ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b21581-4811-4f06-925a-0c465cea78ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d68db9-4c3c-4734-b124-deb61f072259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:52 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Volume cb11c745-7d9f-46de-8d25-6ac3bec29778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb11c745-7d9f-46de-8d25-6ac3bec29778', 'volume_size': 1} Apr 29 10:42:52 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:53 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2" returned: 0 in 0.682s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-d3ffb43e-d697-443a-b795-847bc09a00c2" released by "_copy_volume_from_snapshot" :: held 9.113s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-f149946e-6489-4e64-b6fe-1692802a3f7d-d3ffb43e-d697-443a-b795-847bc09a00c2" released by "_create_volume_from_snapshot" :: held 9.164s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.200s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 15.427s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:53 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Cloning volume 5da6e0d0-2359-4782-be86-63292117471a to volume 7d7a544d-d2f7-4348-aba6-17d0c0402e99 Apr 29 10:42:53 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf" returned: 0 in 0.805s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:53 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf Apr 29 10:42:53 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125a46e3-fd30-484a-af48-ac3fe0445611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ffb43e-d697-443a-b795-847bc09a00c2', 'volume_size': 1, 'snapshot_id': 'f149946e-6489-4e64-b6fe-1692802a3f7d'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072cad09-c9fc-4eb7-875e-a4ea2923677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Creating offline snapshot 699cfc3f-ce87-47c7-92cb-2460c7fc6a13 of volume 5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:42:53 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Volume volume-d3ffb43e-d697-443a-b795-847bc09a00c2 (d3ffb43e-d697-443a-b795-847bc09a00c2): created successfully Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072cad09-c9fc-4eb7-875e-a4ea2923677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Flow 'volume_create_manager' (510bb89f-6167-4e3b-8617-c64a97f0fd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4bd31c-6dd3-4639-80e8-4d7ad3a7a832]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:53 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f59e4499-692a-449f-83cf-e2d40d8998ff tempest-SnapshotDependencyTests-588067298 None] Created volume successfully. Apr 29 10:42:53 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a Apr 29 10:42:53 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:53 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-95dca079-7e03-4367-b9f6-7ae8220c28bf" returned: 0 in 0.592s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-95dca079-7e03-4367-b9f6-7ae8220c28bf" released by "delete_volume" :: held 1.443s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created reservations ['dce8c2b3-c089-4835-94f3-3d15f1deeaf0', '0a85e862-7f77-4a2e-a769-7616e6db7aad', '42c9c5e0-8cbe-4095-812a-5e87adf46543', '73448f00-8a54-4646-9114-cb0ff905c4ba'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:53 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:53 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:53 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a" returned: 0 in 0.746s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:53 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:53 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 1G Apr 29 10:42:53 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "cinder-f149946e-6489-4e64-b6fe-1692802a3f7d-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-f149946e-6489-4e64-b6fe-1692802a3f7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "cinder-quobyte-33da6ac1-af7a-4684-8705-bea445da5f9b" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-33da6ac1-af7a-4684-8705-bea445da5f9b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "cinder-quobyte-f149946e-6489-4e64-b6fe-1692802a3f7d" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-f149946e-6489-4e64-b6fe-1692802a3f7d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Deleting offline snapshot f149946e-6489-4e64-b6fe-1692802a3f7d of volume 33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] snapshot_file for this snap is: volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[de04fb25-66a2-40de-b9b1-4d2cbe248cbd]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-bc1655e9-f192-4707-a7ec-b079b9d4fe7c-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:54 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d Apr 29 10:42:54 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-bc1655e9-f192-4707-a7ec-b079b9d4fe7c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-quobyte-bc1655e9-f192-4707-a7ec-b079b9d4fe7c" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:54 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-bc1655e9-f192-4707-a7ec-b079b9d4fe7c" acquired by "delete_volume" :: waited 0.027s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.687s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:54 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Deleted volume successfully. Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f31f941-4f81-47af-8eb1-bef7ab578dc4]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-154fb925-b173-4d8a-aade-b80359dd7a61 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-95dca079-7e03-4367-b9f6-7ae8220c28bf-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:54 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c Apr 29 10:42:54 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:54 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 1G" returned: 0 in 0.817s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:54 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da6e0d0-2359-4782-be86-63292117471a -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:54 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da6e0d0-2359-4782-be86-63292117471a -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 Apr 29 10:42:54 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:55 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d" returned: 0 in 0.775s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33da6ac1-af7a-4684-8705-bea445da5f9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[5445e8c1-262a-4581-93ff-1ec0146b54cc]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:55 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b Apr 29 10:42:55 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:55 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c" returned: 0 in 0.788s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:55 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c Apr 29 10:42:55 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:55 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da6e0d0-2359-4782-be86-63292117471a -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13" returned: 0 in 0.685s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:55 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 is being set with open permissions: ugo+rw Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:55 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 Apr 29 10:42:55 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:55 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b" returned: 0 in 0.734s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:55 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d Apr 29 10:42:55 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:55 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-bc1655e9-f192-4707-a7ec-b079b9d4fe7c" returned: 0 in 0.640s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:55 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-bc1655e9-f192-4707-a7ec-b079b9d4fe7c" released by "delete_volume" :: held 1.486s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created reservations ['e23786f1-28b9-44e6-9d84-657e028cbda1', 'f3fc24b6-30fa-4421-bcbb-1eb3ee60f8ed', 'f8d071a9-8936-4284-8906-e83d7e9f7e20', '18011f9b-e068-423d-800c-b5cd2559d3a4'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:56 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13" returned: 0 in 0.632s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:56 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.info Apr 29 10:42:56 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:56 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:56 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:56 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d" returned: 0 in 0.714s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:56 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d Apr 29 10:42:56 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-708ebf2e-bc28-4467-bcbc-cfc00ff62135-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-708ebf2e-bc28-4467-bcbc-cfc00ff62135-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:56 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.info" returned: 0 in 0.654s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:56 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.info is being set with open permissions: ugo+rw Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:56 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.info Apr 29 10:42:56 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-quobyte-708ebf2e-bc28-4467-bcbc-cfc00ff62135" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-708ebf2e-bc28-4467-bcbc-cfc00ff62135" acquired by "delete_volume" :: waited 0.032s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a08f107-2692-44f0-b414-91ffd9bfd691]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:56 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.729s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:56 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Deleted volume successfully. Apr 29 10:42:56 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3164cf4a-ab27-48a8-b31e-5b40d503036f tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-bc1655e9-f192-4707-a7ec-b079b9d4fe7c-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:56 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135 Apr 29 10:42:56 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:57 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b.f149946e-6489-4e64-b6fe-1692802a3f7d" returned: 0 in 0.681s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-f149946e-6489-4e64-b6fe-1692802a3f7d" released by "_delete_snapshot" :: held 3.032s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-33da6ac1-af7a-4684-8705-bea445da5f9b" released by "delete_snapshot" :: held 3.058s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Created reservations ['3a87e0fb-1ecd-48c8-b2be-3182a09582c0', '773e1507-816e-4286-b48c-8218abe1a218', '01ff0c8e-4479-445b-b3cd-11382749d891', 'e4e04676-35c6-4a0d-8b15-553656ecef2f'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:57 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Delete snapshot completed successfully. Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d2acab2c-3b05-458a-b82d-2727c3a63775 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-f149946e-6489-4e64-b6fe-1692802a3f7d-delete_snapshot" released by "delete_snapshot" :: held 3.241s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:57 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.info" returned: 0 in 0.752s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-quobyte-7d7a544d-d2f7-4348-aba6-17d0c0402e99" by "_copy_volume_from_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-7d7a544d-d2f7-4348-aba6-17d0c0402e99" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] snapshot: 699cfc3f-ce87-47c7-92cb-2460c7fc6a13, volume: 7d7a544d-d2f7-4348-aba6-17d0c0402e99, {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[104ac589-ae40-4eb1-8463-71e89639d47d]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:57 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 Apr 29 10:42:57 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:57 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135" returned: 0 in 0.806s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:57 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:57 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135 Apr 29 10:42:57 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:58 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13" returned: 0 in 0.690s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da6e0d0-2359-4782-be86-63292117471a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Creating direct copy from snapshot {{(pid=83806) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca37329-6316-4dae-b8b6-7d83ca8f9443]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:58 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-708ebf2e-bc28-4467-bcbc-cfc00ff62135" returned: 0 in 0.609s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-708ebf2e-bc28-4467-bcbc-cfc00ff62135" released by "delete_volume" :: held 1.471s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created reservations ['376fe412-ac76-4718-a8f1-b60ad6427a7a', '8007a869-01a3-4981-89b7-82f2dbc8f35d', 'fef2fef4-62eb-4ac5-a0f7-a52ba9de1179', 'd117046e-19b3-46a5-b299-ca625bb95efe'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:42:58 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a Apr 29 10:42:58 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:58 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "cinder-33da6ac1-af7a-4684-8705-bea445da5f9b-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:58 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-33da6ac1-af7a-4684-8705-bea445da5f9b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "cinder-quobyte-33da6ac1-af7a-4684-8705-bea445da5f9b" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-33da6ac1-af7a-4684-8705-bea445da5f9b" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef30021-22a2-48fd-af4c-67439618e08c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:58 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b Apr 29 10:42:58 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-0cefba78-0ab5-4232-96e2-ac79fab1dcf9-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:58 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-0cefba78-0ab5-4232-96e2-ac79fab1dcf9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:59 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "cinder-quobyte-0cefba78-0ab5-4232-96e2-ac79fab1dcf9" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a" returned: 0 in 0.785s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG cinder.utils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Path /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 not found in is_blk_device check {{(pid=83806) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-0cefba78-0ab5-4232-96e2-ac79fab1dcf9" acquired by "delete_volume" :: waited 0.036s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:42:59 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.688s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:42:59 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 Apr 29 10:42:59 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:59 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Deleted volume successfully. Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ec6e73-2e30-4984-b102-b29cf8023887]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e5a2597c-8db3-4cd6-9e20-af9b63c29604 tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-708ebf2e-bc28-4467-bcbc-cfc00ff62135-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:42:59 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9 Apr 29 10:42:59 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:59 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b" returned: 0 in 0.813s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:59 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b Apr 29 10:42:59 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:42:59 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9" returned: 0 in 0.734s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:42:59 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:42:59 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9 Apr 29 10:42:59 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:00 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-33da6ac1-af7a-4684-8705-bea445da5f9b" returned: 0 in 0.993s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-33da6ac1-af7a-4684-8705-bea445da5f9b" released by "delete_volume" :: held 1.883s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Created reservations ['64f74287-d04e-4887-97dc-fd8588c8b7d4', '09a39596-7b29-477b-af8a-a4a1f7a2d965', 'b51b6d2a-d00b-4b48-b9a3-e15094613e22', '6bc83ef8-9cbd-4ff5-9a20-070d6d08755c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:00 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:43:00 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:00 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-0cefba78-0ab5-4232-96e2-ac79fab1dcf9" returned: 0 in 1.002s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "cinder-d3ffb43e-d697-443a-b795-847bc09a00c2-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-quobyte-0cefba78-0ab5-4232-96e2-ac79fab1dcf9" released by "delete_volume" :: held 1.855s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:00 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-d3ffb43e-d697-443a-b795-847bc09a00c2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "cinder-quobyte-d3ffb43e-d697-443a-b795-847bc09a00c2" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-d3ffb43e-d697-443a-b795-847bc09a00c2" acquired by "delete_volume" :: waited 0.048s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Created reservations ['1cfe82b5-2354-479b-8bc8-d0b9781d6d88', 'd3858f61-8f1e-4edf-94ec-ae5bf6fb5426', 'a91e4b4e-142e-4e9a-a523-571100c1274c', '1de32915-a7aa-4143-97d3-397f886272e7'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e7690e-9e7a-40a4-9380-d6c687281a35]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:01 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:01 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.876s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:01 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:43:01 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Deleted volume successfully. Apr 29 10:43:01 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:43:01 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:01 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-3ea3ba37-be3d-4221-87fa-f5afe0b111a3 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-33da6ac1-af7a-4684-8705-bea445da5f9b-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:03 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2" returned: 0 in 1.896s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:03 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2 Apr 29 10:43:03 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:03 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:03 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 1.869s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:03 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:43:03 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Deleted volume successfully. Apr 29 10:43:03 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-8220de81-9bc2-4d7d-904f-d58c828ed03c tempest-CreateVolumesFromSourceVolumeTest-1719489204 None] Lock "cinder-0cefba78-0ab5-4232-96e2-ac79fab1dcf9-delete_volume" released by "delete_volume" :: held 4.575s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:04 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-d3ffb43e-d697-443a-b795-847bc09a00c2" returned: 0 in 1.025s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-quobyte-d3ffb43e-d697-443a-b795-847bc09a00c2" released by "delete_volume" :: held 3.038s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Created reservations ['b21d6a12-0aa9-4aac-b517-8e2aaff69656', '1acc8458-ba41-40a4-aebe-98c5f5545b27', '6622fb01-d36e-41dd-8df9-fd9f1d941bb0', '3ff58824-40a7-4fd2-bc9f-a29710f64933'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:04 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:43:04 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:04 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99" returned: 0 in 5.928s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[e146cbe2-7667-4435-b194-667da1781cb2]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:04 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:05 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a Apr 29 10:43:05 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:05 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.943s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:05 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:43:05 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Deleted volume successfully. Apr 29 10:43:05 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ce44b24b-90c5-4f8d-b655-ef0cf3bf9258 tempest-SnapshotDependencyTests-588067298 None] Lock "cinder-d3ffb43e-d697-443a-b795-847bc09a00c2-delete_volume" released by "delete_volume" :: held 4.501s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:05 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a" returned: 0 in 1.011s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:05 devstack cinder-volume[83806]: DEBUG cinder.image.image_utils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Image conversion details: src /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 {{(pid=83806) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 10:43:05 devstack cinder-volume[83806]: INFO cinder.image.image_utils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Converted 1024.00 MB image at 172.71 MB/s Apr 29 10:43:05 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 is being set with open permissions: ugo+rw Apr 29 10:43:05 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:06 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 Apr 29 10:43:06 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:06 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99" returned: 0 in 0.594s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-7d7a544d-d2f7-4348-aba6-17d0c0402e99" released by "_copy_volume_from_snapshot" :: held 9.094s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-quobyte-699cfc3f-ce87-47c7-92cb-2460c7fc6a13" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:06 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-699cfc3f-ce87-47c7-92cb-2460c7fc6a13" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Deleting offline snapshot 699cfc3f-ce87-47c7-92cb-2460c7fc6a13 of volume 5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:43:06 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] snapshot_file for this snap is: volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:43:06 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75eadad-3da0-4e41-bbaa-895a2f168899]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:06 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:06 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 Apr 29 10:43:06 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:07 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13" returned: 0 in 0.781s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:07 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da6e0d0-2359-4782-be86-63292117471a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:43:07 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a29713-3b81-49fa-b664-2852ea6fc4ce]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:07 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:07 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a Apr 29 10:43:07 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:08 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a" returned: 0 in 0.749s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:08 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 Apr 29 10:43:08 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:08 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13" returned: 0 in 0.762s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:08 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:08 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13 Apr 29 10:43:08 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:09 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a.699cfc3f-ce87-47c7-92cb-2460c7fc6a13" returned: 0 in 0.601s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-699cfc3f-ce87-47c7-92cb-2460c7fc6a13" released by "_delete_snapshot" :: held 2.983s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.598s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.825s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb11c745-7d9f-46de-8d25-6ac3bec29778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5e842862154fa583cd3976b69656ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:42:53Z,use_quota=True,user_id='5a241b1201d24b3da6ca0db9663966dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Creating volume cb11c745-7d9f-46de-8d25-6ac3bec29778 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:43:09 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e22f513-6168-444d-88da-9e8ae1898963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99', 'volume_size': 1, 'source_volid': '5da6e0d0-2359-4782-be86-63292117471a', 'source_volstatus': 'available'}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:43:09 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778 1073741824 Apr 29 10:43:09 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14288367-109f-4371-9b41-40d0f3e4c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:43:09 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Volume volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 (7d7a544d-d2f7-4348-aba6-17d0c0402e99): created successfully Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14288367-109f-4371-9b41-40d0f3e4c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:43:09 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Flow 'volume_create_manager' (90c06bd7-f14a-4d27-9a59-4c05c9bcd866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:43:09 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-80903e87-459e-4ea6-91af-f2f1007951c1 tempest-VolumeDependencyTests-151890374 None] Created volume successfully. Apr 29 10:43:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-5da6e0d0-2359-4782-be86-63292117471a-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-5da6e0d0-2359-4782-be86-63292117471a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-quobyte-5da6e0d0-2359-4782-be86-63292117471a" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:10 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-5da6e0d0-2359-4782-be86-63292117471a" acquired by "delete_volume" :: waited 0.025s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:10 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778 1073741824" returned: 0 in 0.879s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:10 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e5b0b4-b0ef-4372-8b18-9b27a0b345bf]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:10 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:10 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778 Apr 29 10:43:10 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:10 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a Apr 29 10:43:10 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:11 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778" returned: 0 in 0.708s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:11 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:43:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d68db9-4c3c-4734-b124-deb61f072259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb11c745-7d9f-46de-8d25-6ac3bec29778', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:43:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea209a7b-200f-47a3-a992-ebf401e8b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:43:11 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Volume volume-cb11c745-7d9f-46de-8d25-6ac3bec29778 (cb11c745-7d9f-46de-8d25-6ac3bec29778): created successfully Apr 29 10:43:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea209a7b-200f-47a3-a992-ebf401e8b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:43:11 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Flow 'volume_create_manager' (e1c3ed5a-68a6-4335-91ee-d54b87ca5b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:43:11 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a" returned: 0 in 0.823s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:11 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-09bac199-1a9b-4966-9930-c6b87dcf3016 tempest-CinderUnicodeTest-731828793 None] Created volume successfully. Apr 29 10:43:11 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a Apr 29 10:43:11 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:11 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:11 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-5da6e0d0-2359-4782-be86-63292117471a" returned: 0 in 0.611s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-5da6e0d0-2359-4782-be86-63292117471a" released by "delete_volume" :: held 1.516s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Created reservations ['dc908e88-7d0c-4239-b1e4-34858b1e3001', '1274607d-886f-4a05-9975-b3f8fcfbbc04', 'e138f9a9-9b2d-49fa-ab23-934c25ae9ad0', '4fe1d86c-ee90-4e05-b029-660192b6758c'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:12 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:43:12 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-7d7a544d-d2f7-4348-aba6-17d0c0402e99-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-7d7a544d-d2f7-4348-aba6-17d0c0402e99-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-quobyte-7d7a544d-d2f7-4348-aba6-17d0c0402e99" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:12 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-7d7a544d-d2f7-4348-aba6-17d0c0402e99" acquired by "delete_volume" :: waited 0.020s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.677s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:43:12 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Deleted volume successfully. Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7acb759-44cc-47d4-a34c-a3182df1b33c]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:12 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-d04bc244-8d25-4d54-ad41-cf82517fb2f4 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-5da6e0d0-2359-4782-be86-63292117471a-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:12 devstack sudo[93444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 Apr 29 10:43:12 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.flows.manager.create_volume [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83806) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Flow 'volume_create_manager' (4748bf53-72c6-4e58-9edf-1ad5dff9d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ce4312-6bc1-4b21-acb8-2f5f90ad8454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ce4312-6bc1-4b21-acb8-2f5f90ad8454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:43:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-464446163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c8ed61-fa24-4a70-8a2d-4427c87b7588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5e842862154fa583cd3976b69656ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:43:13Z,use_quota=True,user_id='5a241b1201d24b3da6ca0db9663966dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc9e3ab-0de8-439a-8b97-6549454f36a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc9e3ab-0de8-439a-8b97-6549454f36a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1476ef40-5b2f-4a6c-b012-d8dc2509a86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1476ef40-5b2f-4a6c-b012-d8dc2509a86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c8ed61-fa24-4a70-8a2d-4427c87b7588', 'volume_name': 'volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb652e6-5ff5-4049-a4a9-eee77e2f50a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb652e6-5ff5-4049-a4a9-eee77e2f50a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8dae91f-952e-4b2d-9029-6eb8211fd1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:43:13 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Volume c2c8ed61-fa24-4a70-8a2d-4427c87b7588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588', 'volume_size': 1} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T08:43:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-464446163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c8ed61-fa24-4a70-8a2d-4427c87b7588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c5e842862154fa583cd3976b69656ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T08:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T08:43:13Z,use_quota=True,user_id='5a241b1201d24b3da6ca0db9663966dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d297a33-c7a5-45c1-9381-1c70af9a9639),volume_type_id=2d297a33-c7a5-45c1-9381-1c70af9a9639)}" {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Creating volume c2c8ed61-fa24-4a70-8a2d-4427c87b7588 {{(pid=83806) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Selected osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 as target Quobyte volume. {{(pid=83806) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 10:43:13 devstack cinder-volume[83806]: INFO cinder.volume.drivers.remotefs [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] casted to osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9 Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 1073741824 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:13 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 1073741824 Apr 29 10:43:13 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:13 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99" returned: 0 in 0.836s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:13 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:13 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99 Apr 29 10:43:13 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:13 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 1073741824" returned: 0 in 0.891s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:14 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 Apr 29 10:43:14 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:14 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-7d7a544d-d2f7-4348-aba6-17d0c0402e99" returned: 0 in 0.631s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-7d7a544d-d2f7-4348-aba6-17d0c0402e99" released by "delete_volume" :: held 1.525s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Created reservations ['2881544f-6151-4335-8a75-b4830e1cb843', '7aa2760f-a6b3-4a32-92a1-e6768259d27f', 'e21d9fa9-6aef-488c-b9f0-b64fa8c175ad', '587ae658-aed8-460d-a2c1-6458506f503f'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:14 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:43:14 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:14 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" returned: 0 in 0.652s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'} {{(pid=83806) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8dae91f-952e-4b2d-9029-6eb8211fd1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588', 'volume_size': 1}' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bde7fe-a3b4-45cc-aa1d-3f52734a8e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 10:43:14 devstack cinder-volume[83806]: INFO cinder.volume.flows.manager.create_volume [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Volume volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 (c2c8ed61-fa24-4a70-8a2d-4427c87b7588): created successfully Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bde7fe-a3b4-45cc-aa1d-3f52734a8e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83806) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 10:43:14 devstack cinder-volume[83806]: DEBUG cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Flow 'volume_create_manager' (4748bf53-72c6-4e58-9edf-1ad5dff9d33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83806) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 10:43:14 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-6572fb52-4d47-4753-ab5f-e30cd635c53c tempest-CinderUnicodeTest-731828793 None] Created volume successfully. Apr 29 10:43:15 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-55f51977-fd10-4342-b545-855c6dd95222-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.580s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:43:15 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Deleted volume successfully. Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-55f51977-fd10-4342-b545-855c6dd95222-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-47badea6-ad5f-406f-8281-570195f5ef44 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-7d7a544d-d2f7-4348-aba6-17d0c0402e99-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "cinder-quobyte-55f51977-fd10-4342-b545-855c6dd95222" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-55f51977-fd10-4342-b545-855c6dd95222" acquired by "delete_volume" :: waited 0.022s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[711d93fa-e09e-4df0-a296-2b908701e263]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:15 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 Apr 29 10:43:15 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Creating offline snapshot b8ed6014-f859-41c1-bc64-9da3e05440fe of volume c2c8ed61-fa24-4a70-8a2d-4427c87b7588 {{(pid=83806) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c0b1c-a7d4-40f4-be91-302b5ede6140]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:15 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 Apr 29 10:43:15 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:15 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222" returned: 0 in 0.773s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:15 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:15 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222 Apr 29 10:43:15 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:16 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" returned: 0 in 0.736s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe 1G {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:16 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe 1G Apr 29 10:43:16 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:16 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-55f51977-fd10-4342-b545-855c6dd95222" returned: 0 in 0.624s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-quobyte-55f51977-fd10-4342-b545-855c6dd95222" released by "delete_volume" :: held 1.443s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Created reservations ['1a60eb76-b96d-44af-8ecf-5b2a46b5df5a', '9c229c8c-f30e-43b7-b3f4-36a033a49b4c', 'a1152afe-7766-4cf2-b8bf-c5455c3bba50', '167cc88b-b5ee-4c78-a4df-110acbe2c3d6'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:16 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:43:16 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:16 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe 1G" returned: 0 in 0.741s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:16 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:16 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe Apr 29 10:43:16 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:17 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.616s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:17 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:43:17 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Deleted volume successfully. Apr 29 10:43:17 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-f10e574c-b135-413f-8c95-0954e604aa77 tempest-VolumeDependencyTests-151890374 None] Lock "cinder-55f51977-fd10-4342-b545-855c6dd95222-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:17 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 -F qcow2 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe" returned: 0 in 0.660s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:17 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe is being set with open permissions: ugo+rw Apr 29 10:43:17 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:17 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe Apr 29 10:43:17 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:18 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe" returned: 0 in 0.640s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:18 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.info Apr 29 10:43:18 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:18 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.info" returned: 0 in 0.617s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:18 devstack cinder-volume[83806]: WARNING cinder.volume.drivers.remotefs [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.info is being set with open permissions: ugo+rw Apr 29 10:43:18 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.info {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:18 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.info Apr 29 10:43:18 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:19 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.info" returned: 0 in 0.600s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:19 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.078s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:19 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-62a2bfea-0bac-48dc-880b-f38b3cd760dc tempest-CinderUnicodeTest-731828793 None] Create snapshot completed successfully Apr 29 10:43:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Acquiring lock "cinder-b8ed6014-f859-41c1-bc64-9da3e05440fe-delete_snapshot" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Lock "cinder-b8ed6014-f859-41c1-bc64-9da3e05440fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Acquiring lock "cinder-quobyte-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" by "delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Lock "cinder-quobyte-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Acquiring lock "cinder-quobyte-b8ed6014-f859-41c1-bc64-9da3e05440fe" by "_delete_snapshot" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:20 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Lock "cinder-quobyte-b8ed6014-f859-41c1-bc64-9da3e05440fe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Deleting offline snapshot b8ed6014-f859-41c1-bc64-9da3e05440fe of volume c2c8ed61-fa24-4a70-8a2d-4427c87b7588 {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 10:43:20 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] snapshot_file for this snap is: volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe {{(pid=83806) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 10:43:20 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a380f4-444d-4095-a72c-e05e85a94e0a]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:20 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:20 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe Apr 29 10:43:20 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:21 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe" returned: 0 in 0.722s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:21 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.remotefs [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83806) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 10:43:21 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[8218716c-7203-4247-a374-37a917163106]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:21 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:21 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 Apr 29 10:43:21 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:22 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" returned: 0 in 0.667s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:22 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe Apr 29 10:43:22 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:22 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe" returned: 0 in 0.643s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:22 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:22 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe Apr 29 10:43:22 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:23 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588.b8ed6014-f859-41c1-bc64-9da3e05440fe" returned: 0 in 0.575s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Lock "cinder-quobyte-b8ed6014-f859-41c1-bc64-9da3e05440fe" released by "_delete_snapshot" :: held 2.699s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Lock "cinder-quobyte-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" released by "delete_snapshot" :: held 2.721s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Created reservations ['b9e187a3-ccea-4c62-8a60-c3a4871b3163', '67c0bc34-5a2a-4cf7-b177-d4ac3a3aeee4', '52a54c65-8185-4ec8-b63b-ce18f6bfc802', 'faa8e983-fefd-40f2-a81d-c6d9f1d4d62e'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:43:23 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Delete snapshot completed successfully. Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e8b4f418-16a0-43ab-be6b-707a390f1c29 tempest-CinderUnicodeTest-731828793 None] Lock "cinder-b8ed6014-f859-41c1-bc64-9da3e05440fe-delete_snapshot" released by "delete_snapshot" :: held 2.845s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Acquiring lock "cinder-c2c8ed61-fa24-4a70-8a2d-4427c87b7588-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Lock "cinder-c2c8ed61-fa24-4a70-8a2d-4427c87b7588-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Acquiring lock "cinder-quobyte-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Lock "cinder-quobyte-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" acquired by "delete_volume" :: waited 0.014s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11a0757-49c2-41f1-8f10-d4bbc8ac79ff]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:23 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:23 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 Apr 29 10:43:23 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:24 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" returned: 0 in 0.657s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:24 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:24 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588 Apr 29 10:43:24 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:25 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" returned: 0 in 0.556s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Lock "cinder-quobyte-c2c8ed61-fa24-4a70-8a2d-4427c87b7588" released by "delete_volume" :: held 1.264s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Created reservations ['5fcd6a8b-f8b8-4975-a453-80be6e444d79', 'a83bff11-8f3b-40f5-9e09-18282c812ed1', '617d4098-6564-4ca9-a7b9-a7a40352c995', '5f10fe1c-ef76-4618-9235-7f2f3210aeb8'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:25 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:43:25 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:25 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.555s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:43:25 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Deleted volume successfully. Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-e7b18822-c56c-4810-88c6-5873ca13b724 tempest-CinderUnicodeTest-731828793 None] Lock "cinder-c2c8ed61-fa24-4a70-8a2d-4427c87b7588-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Acquiring lock "cinder-cb11c745-7d9f-46de-8d25-6ac3bec29778-delete_volume" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:25 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Lock "cinder-cb11c745-7d9f-46de-8d25-6ac3bec29778-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Acquiring lock "cinder-quobyte-cb11c745-7d9f-46de-8d25-6ac3bec29778" by "delete_volume" {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 10:43:26 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Lock "cinder-quobyte-cb11c745-7d9f-46de-8d25-6ac3bec29778" acquired by "delete_volume" :: waited 0.013s {{(pid=83806) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 10:43:26 devstack cinder-volume[83806]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ade90c-327d-426b-9105-899a4a9d829e]: (4, 'qcow2') {{(pid=84960) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 10:43:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:26 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778 Apr 29 10:43:26 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:26 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778" returned: 0 in 0.667s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:26 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:26 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778 Apr 29 10:43:26 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:27 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7/volume-cb11c745-7d9f-46de-8d25-6ac3bec29778" returned: 0 in 0.559s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Lock "cinder-quobyte-cb11c745-7d9f-46de-8d25-6ac3bec29778" released by "delete_volume" :: held 1.266s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG cinder.quota [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Created reservations ['a0d6b341-8c4a-4f16-a5b6-24ba4bb1dad0', 'ac1883c7-c1de-41a0-b018-acb775d34646', '17faa83a-8dc3-4c4e-be57-a5f467582b55', '6d04e17a-6b72-4b1d-a000-a1598424e851'] {{(pid=83806) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:27 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:43:27 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:27 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.564s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:27 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:43:27 devstack cinder-volume[83806]: INFO cinder.volume.manager [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Deleted volume successfully. Apr 29 10:43:28 devstack cinder-volume[83806]: DEBUG cinder.coordination [None req-ccd247f2-12e2-4fe2-a0b9-d0eaa262f91d tempest-CinderUnicodeTest-731828793 None] Lock "cinder-cb11c745-7d9f-46de-8d25-6ac3bec29778-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=83806) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 10:43:33 devstack cinder-volume[83806]: DEBUG oslo_service.periodic_task [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83806) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 10:43:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 10:43:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 10:43:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9': None} {{(pid=83806) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 10:43:33 devstack cinder-volume[83806]: DEBUG cinder.volume.drivers.quobyte [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba0e290e-2170-4209-a385-acc9eabb8ff9'] {{(pid=83806) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 10:43:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.lockutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83806) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 10:43:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 10:43:33 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7 Apr 29 10:43:33 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 10:43:33 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Apr 29 10:43:33 devstack cinder-volume[83806]: DEBUG oslo_concurrency.processutils [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e82990b14d73390801b977588051e1c7" returned: 0 in 0.555s {{(pid=83806) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 10:43:33 devstack cinder-volume[83806]: DEBUG cinder.manager [None req-5a966d03-e193-4dde-8e34-8ce3f431062d None None] Notifying Schedulers of capabilities ... {{(pid=83806) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 10:43:37 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:SELECT=85,cinder:INSERT=30,cinder:UPDATE=129,cinder:DELETE=10 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 10:43:37 devstack cinder-volume[83806]: DEBUG dbcounter [-] [83806] Writing DB stats cinder:UPDATE=110,cinder:SELECT=76,cinder:DELETE=7,cinder:INSERT=32 {{(pid=83806) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}